Best method for transferring files between two physical mounted drives within Proxmox?

[Whoops4685]

I am currently new and experimenting with the proxmox environment, and I am interested in understanding the optimal way to transfer files between two physical hdd media disks in my server. I have mounted both drives to separate /mnt/ points within proxmox itself. My purpose, is to increase the amount of storage fro 4TB to 8TB and transferring photos, tv shows and old dvd movies to a larger capacity drive. Then purchase another 8TB storage drive to act as a backup. The only things I am running up to now is a OMV, HAOS, and Plex.

At the moment I have logged in, connected at the physical server and I am using rsync to transfer but it seems quite slow, as in three hours or more to transfer a 350GB music collection within the same computer. Is that normal speed between two spinning platter drives? Or is there a better way that is obvious that I am missing?

I thought about mounting them into my OMV VM and share via SMB but it didn't seem to make a difference (as I'm always getting @30MB/s). I tried drag and drop in a sftp app like Forklift, from my laptop but would get an error.

My pc is an optiplex sff i7 10 gen with 16GB ram, so it shouldn't be bottlenecked, I would think. Interested in anyones thoughts of where I am going wrong. Thanks. Hopefully I have provided enough info.

 

[waltar]

Do "cp -a /mnt/hdd1/* /mnt/hdd1/.??* /mnt/hdd2/." (a=archive mode for timestamps etc).
That's even good with nfs disks when possible only otherwise for remote or broken copies (to not start from beginning) take rsync.
With df look for your /dev/sd<x> 4TB device which has the data to copy
and do "echo 16384 >/sys/block/sd<put_here_your_device_letter>/queue/read_ahead_kb".

 

[ubu]

You can use rsync with

rsync -av /mnt/src/ /mnt/target/

to delete files on target that are not on src add --delete, to use numeric ids use --numeric-ids,
use -X for extended attributes and -A for acls.

You can do a test run without writing anything with --dry-run

 

[waltar]

But local rsync is so much slower than "cp" ...

 

[Whoops4685]

Do "cp -a /mnt/hdd1/* /mnt/hdd1/.??* /mnt/hdd2/." (a=archive mode for timestamps etc).
That's even good with nfs disks when possible only otherwise for remote or broken copies (to not start from beginning) take rsync.
With df look for your /dev/sd<x> 4TB device which has the data to copy
and do "echo 16384 >/sys/block/sd<put_here_your_device_letter>/queue/read_ahead_kb".

Thanks for the advice on the issue, the files on the other drive have been transferred now, the movies seemed to be faster. I am uploading archived home video, through a file transfer app on my main pc and getting speeds of @110MB/s to the drive on Proxmox. That seems more in line with what I was expecting.