pve zfs syncing removes all other snapshots on destination

[mailinglists]

Is there any reason why syncing would have to remove all snapshots on the destination?
Should this be considered a bug?
This is done by pvesr (GUI synchronization).
Would pve-zsync behave differently in pull method?

See:

root@p27:~# zfs list -t all | grep 100
rpool/data/vm-100-disk-1                                 2.41G  5.23T  2.41G  -
rpool/data/vm-100-disk-1@__replicate_100-0_1528282804__     0B      -  2.41G  -
root@p27:~# zfs snapshot rpool/data/vm-100-disk-1@test
root@p27:~# zfs list -t all | grep 100
rpool/data/vm-100-disk-1                                 2.41G  5.23T  2.41G  -
rpool/data/vm-100-disk-1@__replicate_100-0_1528282804__     0B      -  2.41G  -
rpool/data/vm-100-disk-1@test                               0B      -  2.41G  -
root@p27:~# #sync run from source node
root@p27:~# zfs list -t all | grep 100
rpool/data/vm-100-disk-1                                 2.41G  5.23T  2.41G  -
rpool/data/vm-100-disk-1@__replicate_100-0_1528283161__     0B      -  2.41G  -

 

[wolfgang]

Is there any reason why syncing would have to remove all snapshots on the destination?

Yes, we must use the -F (force rollback) operator on the destination side.
The -F operator removes all snapshots after the last synced one on the dest side.
This is necessary because other way zfs will not sync and you get an error.
It is not possible to make on the receiver side snapshots.

 

[mailinglists]

Thank you for your answer.
I will test pve-zsync with pull method to see if it removes the snapshots on the receiving end there.

Is there any reason not to sync to default rpool/data dataset? p27 is a member of a cluster.
(pve-zsync sync --source 10.31.1.26:100 --dest rpool/data --verbose --maxsnap 5 --name test --limit 30000)

 

[wolfgang]

Yes, it is very confusing and has no benefit.
You should you a subset as logical separation.
like rpool/sync

 

[mailinglists]

I see that pve-zsync also removes my snapshots.
Is this also necessary? It seems like it can keep it's snapshots, so in theory it could also leave mine alone.

root@p27:~# zfs snapshot rpool/data/vm-100-disk-1@testeeeeeee
root@p27:~# zfs list -t all | grep 100
rpool/data/vm-100-disk-1                               2.41G  5.23T  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:26:11     0B      -  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:28:18     0B      -  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:29:12     0B      -  2.41G  -
rpool/data/vm-100-disk-1@testeeeeeee                      0B      -  2.41G  -
root@p27:~# pve-zsync sync --source 10.31.1.26:100 --dest rpool/data --verbose --maxsnap 5 --name test --limit 30000
send from @rep_test_2018-06-06_15:29:12 to rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:30:39 estimated size is 624B
total estimated size is 624B
TIME        SENT   SNAPSHOT
root@p27:~# zfs list -t all | grep 100
rpool/data/vm-100-disk-1                               2.41G  5.23T  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:26:11     0B      -  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:28:18     0B      -  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:29:12     0B      -  2.41G  -
rpool/data/vm-100-disk-1@rep_test_2018-06-06_15:30:39     0B      -  2.41G  -

 

[mailinglists]

Yes, it is very confusing and has no benefit.
You should you a subset as logical separation.
like rpool/sync

Tnx, will do.
I think I can create a dataset for each of backups, like weekly, monthly, .. and then create pve-zsync jonbs and backup is perfect without any other scripts.

 

[mailinglists]

Sadly one can not have multiple pve-zsync jobs from the same source to different destinations with different time frames. :-(
So again this is not an full sollution for backups. I guess I will create daily backups for up to XY days and then manually / scriptly create monthly or weekly from those directly on backup server. That could probably work.

 

[mailinglists]

Looks like it is possible:
https://forum.proxmox.com/threads/use-pve-zsync-to-have-daily-weekley-montly-backup.25564/
i guess I did something wrong..