Search results

  1. D

    CEPH: Can we run 2x Cluster network subnet simultanously ?

    I managed to find this guide, I am going to try it out but it looks amazing https://www-pivert-org.translate.goog/comment-ajouter-un-storage-network-a-ceph-sur-proxmox/?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en&_x_tr_pto=wapp
  2. D

    CEPH: Can we run 2x Cluster network subnet simultanously ?

    Hi mfed, could you possibly give an example of the ECMP config please TIA
  3. D

    Removing Ceph Completely

    Hi all. I found this works well to completely remove ceph and config systemctl stop ceph-mon.target systemctl stop ceph-mgr.target systemctl stop ceph-mds.target systemctl stop ceph-osd.target rm -rf /etc/systemd/system/ceph* killall -9 ceph-mon ceph-mgr ceph-mds rm -rf /var/lib/ceph/mon/...
  4. D

    PVE6 and Mikrotik EoIP

    OK perfect, thank you - I WIll have to use QDevice and later purchase another server
  5. D

    PVE6 and Mikrotik EoIP

    Here is the syslog of the node3 trying to join the cluster https://pastebin.com/PV7n1WBY Futher to this - my /etc/hosts is correct with the correct IP's and hostnames
  6. D

    PVE6 and Mikrotik EoIP

    Ok So these were my findings: MPLS/VPLS&VLAN - Tries to connect, establishes connection but throughput too slow, eventually collpases [1.96MBps] L2TP/EoIP&VLAN - Connects and joins, waiting for quorum, all nodes reboot and the entire cluster dies, have to forcefully remove remote node and wait...
  7. D

    PVE6 and Mikrotik EoIP

    I most certainly will share - I just want to know from @Alwin if that would suit the Promox VE6 cluster to join over WAN as he suggested. I will try connect the cluster during the week and post my results Thank you
  8. D

    PVE6 and Mikrotik EoIP

    Yeah alot better EoIP = 4.608ms L2TP,MPLS/VPLS =0.140ms
  9. D

    PVE6 and Mikrotik EoIP

    The std dev is now 0.140ms
  10. D

    PVE6 and Mikrotik EoIP

    I was referring to this post https://forum.proxmox.com/threads/pve6-and-mikrotik-eoip.59536/post-274785 The std dev was too great to accommodate a cluster over WAN
  11. D

    PVE6 and Mikrotik EoIP

    Hi again I have setup a MPLS/VPLS over L2TP Would this work in connect the remote node3 to the cluster
  12. D

    PVE6 and Mikrotik EoIP

    proxy-arp on the L2TP interface? Do I attach the VLANs to the L2TP interface and then bridge it?
  13. D

    PVE6 and Mikrotik EoIP

    I more than happy to change the network for it operate more efficiently. I will try the proxy-arp What suggestions do you have for me to change the network. Thank you
  14. D

    PVE6 and Mikrotik EoIP

    Hi there. We have a CCR in the data centre that node1 and node2 are connected directly with SFP+ We then have a RB3011 in our satellite office, an L2TP vpn connection between them and then the EoIP on top of the L2TP. I have setup L2TP because the satellite office is being provided...
  15. D

    PVE6 and Mikrotik EoIP

    Thank you so much I tried again last night and it failed again I have setup a QDevice on that node3 and setup HA Thank you once again for all your assistance
  16. D

    PVE6 and Mikrotik EoIP

    I don't want it to join the storage - I just need this machine to act as a voting node for the HA between node1 and node2 I will try again tonight and post results Thank you so so much for you assistance! and such an amazing piece of software
  17. D

    PVE6 and Mikrotik EoIP

    I will investigate this I will try again tonight and publish results unicast seems to be working I have checked the logs and it appears that node3 was trying to access local-zfs like the other 2 but I have set that up differently. Could that have caused the "hang". I have restricted the...
  18. D

    PVE6 and Mikrotik EoIP

    node1: 192.168.2.4 : unicast, xmt/rcv/%loss = 9538/9526/0%, min/avg/max/std-dev = 1.431/2.052/172.618/4.608 192.168.2.4 : multicast, xmt/rcv/%loss = 9538/9526/0%, min/avg/max/std-dev = 1.482/2.116/172.656/4.607 node3: 192.168.2.2 : unicast, xmt/rcv/%loss = 10000/9961/0%...
  19. D

    PVE6 and Mikrotik EoIP

    Please can anyone assist me. I am trying to connect node3 to my cluster, I have a Mikrotik EoIP tunnel with all the vlans setup etc - unicast and multicast 100% successful, however - when I try join the node to the cluster: waiting for quorum .. OK and then it just waits, I see the interfaces...