So ive just updated a cluster from proxmox 6.4 to 7.1 (along with ceph from 14 to 16).
Everything works fine except one thing, and that is the dashboard.
If i try to enable it i get:
ceph mgr module enable dashboard
Error ENOENT: all mgr daemons do not support module 'dashboard', pass --force...
Im trying to find a way to use proxmox with ceph as a multi site failover cloud setup of some sorts :).
So i have 2 proxmox clusters with ceph, in different locations.
They see each-other via site-to-site vpn, and have configured mirroring (journaling) with rbd on a pool (on all its images)...
So im looking for a way to autobackup the config files of all the vms in a cluster.
Has anyone tried to do this ?
What would be a good way to achieve this ?
Maybe use something like rsync on all nodes ?
Is there a way to get all the configs in one place\folder ?
So it turns out the problem was that not all nodes could communicate with each other.
So the problem was related to ipsec it seems.
The clusters were behind gateways that had an ipsec tunnel. And all could ping each other but one node could not communicate at all with the nodes on the other...
So i have followed the instructions here https://pve.proxmox.com/wiki/Ceph_RBD_Mirroring , in order to mirror images from a ceph cluster to another.
I have done this before, and it has worked, but not this time.
I think i have done everything correct, like creating preparing the pool, creating...
The second cluster is used just for storing different stuff like backups and other files, and maybe some vms related to that.
I have not used PBS in any way. Ive just followed and read about it from the moment it was in beta.
So i have an existing proxmox cluster with 4 nodes, using ceph.
Ceph is configured to use a separate 10GB network, and it has the same subnet for both public and cluster network.
What i would need to is to have this network be able to communicate with another ceph cluster in order to mirror...
Why use the disks directly on PBS ? That would probably mean i should have a separate server, with raid disks on them, and use them in pbs. That would not be to flexible.
Couldnt i just mount a cephfs in PBS (the one the i use now for backups)?
I know it took a lot to answer this, but i just did not have time.
So yes, both clusters use ceph. Right now the backups from one cluster are made on the cephfs volume that exists on the other cluster.
I would want to use pbs somehow so that i could do incremental backups.
Dont know what was going on, but after rebooting all the nodes everything was fine. I was able to create the mon on the 4th node and it was picked up by the others, and was showing in "ceph -s".
Im having a problem with a daemon on a 4node cluster.
I initially saw that it wasnt showing up correctly in the gui (it had question mark beside it).
So i tried to destroy it and it did not work.
So i ended up doing this:
- stopped the service manually
- disabled the service
- removed...
Im thinking of using Proxmox Backup Server but im not really sure how to do it so that the backup system is redundant (at least to a certain point)
So right now i have a proxmox cluster with multiple nodes, and uses ceph.
I then have another proxmox cluster that that uses ceph-client to mount...
Well this was kind of weird. So i ended up trying to reboot the other nodes, and when i tried that with the first one, the mon did not start.
When i checked the logs i got an error like this:
rocksdb: IO error: While opening a file for sequentially reading...
Im having a similar problem. Could you go into details to what you actually did.
How did you go about creating the monitor with ceph if the service was created and running ?
So i dont know what exactly happened but today i saw that one of the monitors on one of my notes was stopped.
I tryed to start it but nothing.
I rebooted the node, and it still did not start.
The problem was that the ceph-mon@xxx.service was running, just that the cluster was saying it was...
I would use two proxmox clusters, each using ceph. Lets say: PVE_STORAGE and PVE_VMS.
I would create a container on PVE_STORAGE with Proxmox Backup Server.
Ideally i would be able to mounth the cephfs of PVE_STORAGE as a datastore in the Proxmox Backup Server container.
I would then add...
I have a proxmox ve cluster, configured with ceph.
Could i install this as a vm on another cluster and have it use the ceph cluster on the first cluster i mentioned ?
Im thinking that would mean being able to add a ceph datastore on the backup server.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.