why is rsync so slow ?

[peter247]

trying to copy a parts zpool from one computer to another both running zfs , but not a cluster .
Tried a SMB share and using rsync -arpvh /sorce /des , which works o.k , but slow .
Not bandwidth , cpu , or io limited but get 70 M/S on a easy 300M/S connection .
Can easy get the 300M/S which is a 10gb sfp+ link to the switch and 2.5gb out .

 

[Kingneutron]

Try rclone, it's multi-threaded - or look into zfs send/recv and syncoid/sanoid

Example:


time rclone sync -P --copy-links --retries=2 --low-level-retries=2 \
--sftp-disable-hashcheck \
--transfers=4 --stats=2s \
--inplace --metadata \
--multi-thread-write-buffer-size 512k \
--no-update-modtime --update \
--exclude=dvdrips-shr/** --exclude=.fseventsd/** \
/Volumes/ztoshtera6/ \
qotom-proxmox-25g:/ztoshtera6macpromir \
--log-file ~/bkp-ztoshtera6-rclone-qotom-proxmox-errors.log