Ceph multi location server and public ip
- Thread starter yycapote
- Start date
We have 3 Proxmox in three of our offices in different locations with static IPs and fiber optic connection and the couster works super well.
On the other hand, ceph does not work,
the problem is that since the network is different, the OSD does not work and the monitoring is successful on the main server when you try to add an OSD cloud on another Node it gives you this error:::: get time out (500 ),
and if you try to create a monitor then you have this error ::::
Could not connect to ceph cluster despite configured monitors (500)
I have tried with local IP and it does not work with public IP and it does not work with domain and OPEN VPN by modifying the configuration file and nothing if you have the solution I need it and I am willing to pay to fix it.
thank you
On the other hand, ceph does not work,
the problem is that since the network is different, the OSD does not work and the monitoring is successful on the main server when you try to add an OSD cloud on another Node it gives you this error:::: get time out (500 ),
and if you try to create a monitor then you have this error ::::
Could not connect to ceph cluster despite configured monitors (500)
I have tried with local IP and it does not work with public IP and it does not work with domain and OPEN VPN by modifying the configuration file and nothing if you have the solution I need it and I am willing to pay to fix it.
thank you
I don't know exactly what your goal is. But I wouldn't build something like that. You won't achieve high availability with this. If you lose your connection, everything is available in all offices. If you only lose one office, it only works as long as all locations can see each other.
I would rather advise you to put all three servers in one location and connect the others via VPN. You can perhaps put one or two PBS there and also have an off-site data backup.
Do I understand you correctly that every office has its own IPv4 subnet? If so, then it simply cannot work that way. You then have to do the routing somehow, either directly on the node or via a local PfSense. Instead of OpenVPN, an IPSec tunnel might be more suitable for your project.
Yes, I have a solution for this. You first have to set up a comprehensive network before you think about services behind it. My suggestion would be to connect the locations via IPSec, define a private IP network and then put the CEPH and the nodes in there.
Otherwise, as mentioned, it's better to put everything centrally and move the backup servers to the other locations. But at some point the CEPH or Corosync will blow up in your face. I wouldn't want to build and maintain something like that.