So i have been testing for a while what ways i have to replicate VMs and, because i was using ceph, tried rbd mirroring, following the instructions found here.
Everything worked fine until i tried to do this on images that were used by lxc containers. Then i ran into all sorts of problems. The containers just wont start if the image has the journaling feature enabled, and you cant to backups anymore. From what i understand this is related to the current kernel, that cannot use this feature (im not aware of any workaround).
Then i tried to use the snapshot mode, but i just wasnt able to make it work. I was able to create the peers, enable the mirroring mode, etc, but just cannot make it to work.
When i enable the rbd mirror daemon on the backup cluster i get stuff like this in the logs:
I saw a lot of people trying to make it work, but were not able, like this one here :
https://forum.proxmox.com/threads/ceph-rbd-mirroring-snapshot-based-not-working.91431/
So im not sure what i can do to sync the vms across another site. Im thinking the last resort is to use something to sync the backups made maybe.
So what im asking everyone is this. Has anyone been able to :
1. use rbd mirroring with the journaling feature enabled on disks used in lxc containers?
2. use rbd mirroring in snapshot mode
3. use any alternate method to sync disks or backups to another site (asuming that nodes on each site see each other).
Everything worked fine until i tried to do this on images that were used by lxc containers. Then i ran into all sorts of problems. The containers just wont start if the image has the journaling feature enabled, and you cant to backups anymore. From what i understand this is related to the current kernel, that cannot use this feature (im not aware of any workaround).
Then i tried to use the snapshot mode, but i just wasnt able to make it work. I was able to create the peers, enable the mirroring mode, etc, but just cannot make it to work.
When i enable the rbd mirror daemon on the backup cluster i get stuff like this in the logs:
2022-02-17 16:11:53.959 7fafd19bb700 -1 rbd::mirror::image_replayer:repareRemoteImageRequest: 0x562dd0205880 handle_register_client: failed to register with remote journal: (2) No such file or directory
2022-02-17 16:12:23.951 7fafd19bb700 -1 rbd::mirror::image_replayer:
2022-02-17 16:12:53.987 7fafd19bb700 -1 rbd::mirror::image_replayer:
2022-02-17 16:13:23.955 7fafd19bb700 -1 rbd::mirror::image_replayer:
2022-02-17 16:13:53.988 7fafd19bb700 -1 rbd::mirror::image_replayer:
I saw a lot of people trying to make it work, but were not able, like this one here :
https://forum.proxmox.com/threads/ceph-rbd-mirroring-snapshot-based-not-working.91431/
So im not sure what i can do to sync the vms across another site. Im thinking the last resort is to use something to sync the backups made maybe.
So what im asking everyone is this. Has anyone been able to :
1. use rbd mirroring with the journaling feature enabled on disks used in lxc containers?
2. use rbd mirroring in snapshot mode
3. use any alternate method to sync disks or backups to another site (asuming that nodes on each site see each other).