Slow Downloads/Updates

[Deleted member 252865]

Minisforum UN100L, Realtek 1 Gbps Port, 1 Gbps symmetrical from ISP.

Fresh install Proxmox 8.2, add no subscription repo, updates at ~300 kB/s.

Installed and ran speedtest-cli, shows expected speeds 800+ Mbps.

Fresh install Ubuntu 24.04, updates at expected speeds ~120 MB/s.

Trying to download the Debian 12 template on Proxmox takes forever but downloading the same file on Ubuntu completes instantly.

This means its an issue with Proxmox, not the NIC, the cable, or ISP.

Already tried adding download.proxmox.com to /etc/hosts method from a similar thread no luck.

Anyone have a clue? Thanks.

 

[smokethrower2]

Experiencing the exact same thing right now trying to download the debian 12 template. 120mb download, so far at 17 mins 33s its 26% done... quite lovely.

 

[Ernst T.]

I have tested the download. No problem at all (4s).
Strange ...

 

[smokethrower2]

It seemed to have speed up the 2nd half, the final 47% probably took only a few minutes. I kept the log to put in here. I made the post after the first entry, turns out the time it gave at the % amount done was the estimated time left, not time to that point. But still, in all it took over 23 minutes for me on a 1Gb connection. A few months ago when I did it on a diff Proxmox instance it only took me a few seconds, so it does seem intermittent. Below was the in the output log.

0K ........ ........ ........ ........ 26% 85.8K 17m33s
32768K ........ ........ ........ ........ 53% 88.7K 11m1s
65536K ........ ........ ........ ........ 79% 87.4K 4m45s
98304K ........ ........ ........ 100% 90.8K=23m20s

 

[Ernst T.]

Which IP was used for the download? For me it was:

Connecting to download.proxmox.com (download.proxmox.com)|212.224.123.70|:80... connected.

 

[smokethrower2]

Here's the entire log, but the IP it connected to was: 170.130.165.90

downloading http://download.proxmox.com/images/system/debian-12-standard_12.2-1_amd64.tar.zst to /var/lib/vz/template/cache/debian-12-standard_12.2-1_amd64.tar.zst
--2024-09-06 23:15:21-- http://download.proxmox.com/images/system/debian-12-standard_12.2-1_amd64.tar.zst
Resolving download.proxmox.com (download.proxmox.com)... 170.130.165.90, 2a0b:7140:8:100::90
Connecting to download.proxmox.com (download.proxmox.com)|170.130.165.90|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 126129049 (120M) [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-12-standard_12.2-1_amd64.tar.zst.tmp_dwnl.1187388'
0K ........ ........ ........ ........ 26% 85.8K 17m33s
32768K ........ ........ ........ ........ 53% 88.7K 11m1s
65536K ........ ........ ........ ........ 79% 87.4K 4m45s
98304K ........ ........ ........ 100% 90.8K=23m20s
2024-09-06 23:38:42 (88.0 KB/s) - '/var/lib/vz/template/cache/debian-12-standard_12.2-1_amd64.tar.zst.tmp_dwnl.1187388' saved [126129049/126129049]
calculating checksum...OK, checksum verified
download of 'http://download.proxmox.com/images/system/debian-12-standard_12.2-1_amd64.tar.zst' to '/var/lib/vz/template/cache/debian-12-standard_12.2-1_amd64.tar.zst' finished
TASK OK

 

[hazyfutute]

i had the same issue downloading debian-12 template

downloading http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst to /var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst
--2024-09-25 00:51:23--  http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst
Resolving download.proxmox.com (download.proxmox.com)... 51.79.228.122, 2402:1f00:8001:f7a::65
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 126515062 (121M) [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528'
     0K ........ ........ ........ ........ 26% 47.6K 31m47s
 32768K ........ ........ ........ ........ 53% 56.1K 18m47s
 65536K ........ ........ ........ ........ 79% 50.2K 8m15s
 98304K ........ ........ ..                94% 42.3K=39m23s
2024-09-25 01:45:46 (49.4 KB/s) - Read error at byte 119591512/126515062 (Connection timed out). Retrying.
--2024-09-25 01:45:47--  (try: 2)  http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 126515062 (121M), 6923550 (6.6M) remaining [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528'
        [ skipping 98304K ]
 98304K ,,,,,,,, ,,,,,,,, ,,......         100% 45.5K=2m29s
2024-09-25 01:48:16 (45.5 KB/s) - '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528' saved [126515062/126515062]
calculating checksum...OK, checksum verified
download of 'http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst' to '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst' finished
TASK OK

edit: my timezone is gmt +8 incase anyone from proxmox wants to investigate this.

 

[smokethrower2]

Dang, yours was even slower than mine! And a different IP too, so seems it's not just one server. Looks like you had an error during yours and it was able to reconnect and get what was left fast at least. Definitely something going on with their servers from time to time.

 

[upsangel]

i had the same issue downloading debian-12 template

downloading http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst to /var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst
--2024-09-25 00:51:23--  http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst
Resolving download.proxmox.com (download.proxmox.com)... 51.79.228.122, 2402:1f00:8001:f7a::65
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 126515062 (121M) [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528'
     0K ........ ........ ........ ........ 26% 47.6K 31m47s
 32768K ........ ........ ........ ........ 53% 56.1K 18m47s
 65536K ........ ........ ........ ........ 79% 50.2K 8m15s
 98304K ........ ........ ..                94% 42.3K=39m23s
2024-09-25 01:45:46 (49.4 KB/s) - Read error at byte 119591512/126515062 (Connection timed out). Retrying.
--2024-09-25 01:45:47--  (try: 2)  http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 126515062 (121M), 6923550 (6.6M) remaining [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528'
        [ skipping 98304K ]
 98304K ,,,,,,,, ,,,,,,,, ,,......         100% 45.5K=2m29s
2024-09-25 01:48:16 (45.5 KB/s) - '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst.tmp_dwnl.2510528' saved [126515062/126515062]
calculating checksum...OK, checksum verified
download of 'http://download.proxmox.com/images/system/debian-12-standard_12.7-1_amd64.tar.zst' to '/var/lib/vz/template/cache/debian-12-standard_12.7-1_amd64.tar.zst' finished
TASK OK

edit: my timezone is gmt +8 incase anyone from proxmox wants to investigate this.

Exactly same situation at GMT+8, I am downloading Debian11 template and it only download 20MB after 1.5hr:

downloading http://download.proxmox.com/images/system/debian-11-standard_11.7-1_amd64.tar.zst to /var/lib/vz/template/cache/debian-11-standard_11.7-1_amd64.tar.zst
--2024-09-25 17:54:43--  http://download.proxmox.com/images/system/debian-11-standard_11.7-1_amd64.tar.zst
Resolving download.proxmox.com (download.proxmox.com)... 51.79.228.122, 2407:6180:1:a:41::50
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 122247556 (117M) [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-11-standard_11.7-1_amd64.tar.zst.tmp_dwnl.4416'
     0K .....                                4% 13.6K=6m44s
2024-09-25 18:01:29 (13.6 KB/s) - Connection closed at byte 5615752. Retrying.
--2024-09-25 18:01:30--  (try: 2)  http://download.proxmox.com/images/system/debian-11-standard_11.7-1_amd64.tar.zst
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 122247556 (117M), 116631804 (111M) remaining [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-11-standard_11.7-1_amd64.tar.zst.tmp_dwnl.4416'
     0K ,,,,,.                               5% 15.5K=77s
2024-09-25 18:17:47 (15.5 KB/s) - Read error at byte 6839015/122247556 (Connection timed out). Retrying.
--2024-09-25 18:17:49--  (try: 3)  http://download.proxmox.com/images/system/debian-11-standard_11.7-1_amd64.tar.zst
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 122247556 (117M), 115408541 (110M) remaining [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-11-standard_11.7-1_amd64.tar.zst.tmp_dwnl.4416'
     0K ,,,,,,.. .......                    13% 13.7K=11m18s
2024-09-25 18:44:10 (13.7 KB/s) - Read error at byte 16341750/122247556 (Connection timed out). Retrying.
--2024-09-25 18:44:13--  (try: 4)  http://download.proxmox.com/images/system/debian-11-standard_11.7-1_amd64.tar.zst
Connecting to download.proxmox.com (download.proxmox.com)|51.79.228.122|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 122247556 (117M), 105905806 (101M) remaining [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/debian-11-standard_11.7-1_amd64.tar.zst.tmp_dwnl.4416'