sync on HDD and USB3 HDD slow

[Nicolas550]

Hello,

I try some configuration but allways i got a small speed ~15Mo/s for sync data on HDD host and USB3 drive on NTFS.

I try to mount passtrought USB on windows Vm and transfert accros lan or mount the both disks on host and sync.

I sue rsync on linux or rsync and savdisk on windows

Some one can explain me how fix?

PS: I move 5To data's and 3 days for sync it's... more than boring

Thx.

 

[datschlatscher]

You have multiple possible (and likely) bottlenecks in your setup. It really comes down to how fast your HDDs actually are, how big (or small) the files are that you are moving and that you are using USB to move data.

It seems to me you are moving lots of (rather) small files which will always show a rather strong effect on disk performance and are using an external hard drive. Potential fixes would be to change the way you "install" your hard drive e.g. directly attaching it to a SATA port in the PC. Alternatively, you could change the way you sync/copy the data by moving it in bigger batches (though this might be inconvenient for syncing purposes.)

The only way to really "fix" this problem would be to examine how much read/write speed you actually get out of your HDDs and in the worst case switching to something faster (i.e. SSDs) and installing them directly to your computer rather than using USB connections. Nonetheless, If the process isn't very time critical, simply waiting until the sync is finished might still be an option.

 

[Dunuin]

Jup, copying only small files my HDDs can only less than 1MB/s. Copying only big files they can get up to 180MB/s. So it really depends on the workload. HDDs are only good at asynconous big sequential reads/writes and terrible at small random reads/writes (IOPS) or any synchonous writes.