Webserver/NFS file download from USB 3 device (10-20 MB/s)

[voarsh]

I am getting roughly just under 1 Gbps/s on this test, but when I try and download a file from server on the network via a USB (3.0) HDD, I expect at least USB 3 speeds.




Everything is connected to the 1 GB network, all nodes have 1 GB connection, so why does my download only get 5-10 MB/s (average) (max 22 MB/s once for a short time)?


- Update

One thing I will add is that the USB HDD mount is not in the hundred's of MB/s USB 3 should be:




--- Update

I changed my NFS export to use async not sync and saw a small improvement:

 

[Dunuin]

Did you enabled xhci in BIOS? On my NAS (Supermicro mainboard) it was set to "auto" by default and I was wondering why my USB3-HDD is so slow. If xhci is disabled or not working your USB3-Ports will only operate in USB2 mode. I needed to set it from "auto" to "enable".

 

[voarsh]

Did you enabled xhci in BIOS? On my NAS (Supermicro mainboard) it was set to "auto" by default and I was wondering why my USB3-HDD is so slow. If xhci is disabled your USB3-Ports will only operate in USB2 mode. I needed to set it from "auto" to "enable".

I am downloading directly from a Proxmox host.
I've not seen this option in the BIOS before - I would need to schedule a period to turn the host off and pull out the HDD to trigger BIOS screens.

Even weirder, a lot of disk read is happening but not the same transfer speed (you'd expect after reading high amount of data (ATTN: NFSD)





Gathering from this I assume it is enabled though?

 

[Dunuin]

If "Bus 04 Port 2" is your USB HDD it looks like it is working in xhci mode so that should be fine.
Maybe just alot of overhead if your 22MB/s transfer speed is causing 98MB/s disc reads?

 

[voarsh]

If "Bus 04 Port 2" is your USB HDD it looks like it is working in xhci mode so that should be fine.
Maybe just alot of overhead if your 22MB/s transfer speed is causing 98MB/s disc reads?

Yes, I suppose it is on.
I'm not sure what overhead there can be?
Really frustrating to have upgraded to 1 Gbp/s and only get 22 MB/s.
If I really needed to I can connect it directly to another computer with USB 3 but it defeats the purpose of shared networked storage.....

 

[Dunuin]

I'm still not sure how you use that HDD...
1.) I saw a download from a Nextcloud
2.) I saw a windows copy (is it using NFS or CIFS or WebDAV?)

What is the actual setup?
USB-HDD (what filesystem?) mounted to Proxmox, mountpoint of that bind-mounted into a Nextcloud LXC?

 

[voarsh]

I'm still not sure how you use that HDD...
1.) I saw a download from a Nextcloud
2.) I saw a windows copy (is it using NFS or CIFS or WebDAV?)

What is the actual setup?
USB-HDD (what filesystem?) mounted to Proxmox, mountpoint of that bind-mounted into a Nextcloud LXC?

I tried Nextcloud for a simple apache download (this would be across 2 machines)
I've tried SCP (direct from the host with the USB) download to a local computer, seems slightly slower than NFS.
And lastly, Windows NFS client download via the NFS server that has USB mounted as a folder on the host.

 

[voarsh]

Just an update, I've been told it's probably worth formatting the drive to EXT4 format.