Webserver/NFS file download from USB 3 device (10-20 MB/s)

V

voarsh

Active Member
Nov 20, 2020
218
20
38
29
I am getting roughly just under 1 Gbps/s on this test, but when I try and download a file from server on the network via a USB (3.0) HDD, I expect at least USB 3 speeds.

1610856813553.png


Everything is connected to the 1 GB network, all nodes have 1 GB connection, so why does my download only get 5-10 MB/s (average) (max 22 MB/s once for a short time)?


- Update

One thing I will add is that the USB HDD mount is not in the hundred's of MB/s USB 3 should be:

1610856822069.png


--- Update

I changed my NFS export to use async not sync and saw a small improvement:



1610856832093.png
 
Did you enabled xhci in BIOS? On my NAS (Supermicro mainboard) it was set to "auto" by default and I was wondering why my USB3-HDD is so slow. If xhci is disabled or not working your USB3-Ports will only operate in USB2 mode. I needed to set it from "auto" to "enable".
 
Last edited:
Dunuin said:
Did you enabled xhci in BIOS? On my NAS (Supermicro mainboard) it was set to "auto" by default and I was wondering why my USB3-HDD is so slow. If xhci is disabled your USB3-Ports will only operate in USB2 mode. I needed to set it from "auto" to "enable".
Click to expand...
I am downloading directly from a Proxmox host.
I've not seen this option in the BIOS before - I would need to schedule a period to turn the host off and pull out the HDD to trigger BIOS screens.

Even weirder, a lot of disk read is happening but not the same transfer speed (you'd expect after reading high amount of data (ATTN: NFSD)
1610858284627.png


1610858376550.png

Gathering from this I assume it is enabled though?
1610858513331.png
 
Last edited:
If "Bus 04 Port 2" is your USB HDD it looks like it is working in xhci mode so that should be fine.
Maybe just alot of overhead if your 22MB/s transfer speed is causing 98MB/s disc reads?
 
Dunuin said:
If "Bus 04 Port 2" is your USB HDD it looks like it is working in xhci mode so that should be fine.
Maybe just alot of overhead if your 22MB/s transfer speed is causing 98MB/s disc reads?
Click to expand...
Yes, I suppose it is on.
I'm not sure what overhead there can be?
Really frustrating to have upgraded to 1 Gbp/s and only get 22 MB/s.
If I really needed to I can connect it directly to another computer with USB 3 but it defeats the purpose of shared networked storage.....
 
I'm still not sure how you use that HDD...
1.) I saw a download from a Nextcloud
2.) I saw a windows copy (is it using NFS or CIFS or WebDAV?)

What is the actual setup?
USB-HDD (what filesystem?) mounted to Proxmox, mountpoint of that bind-mounted into a Nextcloud LXC?
 
Dunuin said:
I'm still not sure how you use that HDD...
1.) I saw a download from a Nextcloud
2.) I saw a windows copy (is it using NFS or CIFS or WebDAV?)

What is the actual setup?
USB-HDD (what filesystem?) mounted to Proxmox, mountpoint of that bind-mounted into a Nextcloud LXC?
Click to expand...
I tried Nextcloud for a simple apache download (this would be across 2 machines)
I've tried SCP (direct from the host with the USB) download to a local computer, seems slightly slower than NFS.
And lastly, Windows NFS client download via the NFS server that has USB mounted as a folder on the host.
 
Just an update, I've been told it's probably worth formatting the drive to EXT4 format.
 
You must log in or register to reply here.
Top Bottom