Extremely Slow Download of Updates

G

gfngfn256

Renowned Member
Mar 29, 2023
1,528
416
88
While doing now the usual Proxmox VE updates in shell, I'm getting extremely low download rates. Example:

Get:1 http://download.proxmox.com/debian/pve bullseye/pve-no-subscription amd64 pve-kernel-5.15.107-2-pve amd64 5.15.107-2 [76.8 MB]
19% [1 pve-kernel-5.15.107-2-pve 1747 kB/76.8 MB 2%] 3140 B/s 6h 38min 24s

It eventually cuts out completely.

This has never happened in the past.

Tested general Internet speeds /sites, no problem at my end.

Anybody else experiencing this? Maybe something up with http://download.proxmox.com/ ? Everybody downloading at once?

Thanks.
 
Did the connection time out in the end?
Which IP did it mention?

We had another report where one of our CDNs seems to be slow. The IP would help identify the CDN that's used.
 
Last edited:
Thanks for fast response.
Yes it does time out - and It gave me an IP, but I forget its number! (All I remember is that it began "50." etc..)
I'll try and catch it again soon.
 
Now its not timing out - but just "dribbling" data:

Starting system upgrade: apt-get dist-upgrade
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following package was automatically installed and is no longer required:
pve-kernel-5.15.102-1-pve
Use 'apt autoremove' to remove it.
The following NEW packages will be installed:
pve-kernel-5.15.107-2-pve
The following packages will be upgraded:
libpve-common-perl libpve-rs-perl pve-kernel-5.15
3 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 76.8 MB/78.8 MB of archives.
After this operation, 400 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://download.proxmox.com/debian/pve bullseye/pve-no-subscription amd64 pve-kernel-5.15.107-2-pve amd64 5.15.107-2 [76.8 MB]
22% [1 pve-kernel-5.15.107-2-pve 4451 kB/76.8 MB 6%] 673 B/s 1d 5h 51min 53s
 
Here it is - just timed out:

The following package was automatically installed and is no longer required:
pve-kernel-5.15.102-1-pve
Use 'apt autoremove' to remove it.
The following NEW packages will be installed:
pve-kernel-5.15.107-2-pve
The following packages will be upgraded:
libpve-common-perl libpve-rs-perl pve-kernel-5.15
3 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 76.8 MB/78.8 MB of archives.
After this operation, 400 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://download.proxmox.com/debian/pve bullseye/pve-no-subscription amd64 pve-kernel-5.15.107-2-pve amd64 5.15.107-2 [76.8 MB]
Err:1 http://download.proxmox.com/debian/pve bullseye/pve-no-subscription amd64 pve-kernel-5.15.107-2-pve amd64 5.15.107-2
Connection timed out [IP: 51.79.159.216 80]
E: Failed to fetch http://download.proxmox.com/debian/...ve-kernel-5.15.107-2-pve_5.15.107-2_amd64.deb Connection timed out [IP: 51.79.159.216 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

System not fully up to date (found 4 new packages)

starting shell
root@DELL-PRXMX:/#
 
Does it work if you access another CDN?
You can add the following to your /etc/hosts file and then run the full-upgrade again:
212.224.123.70 download.proxmox.com

It will resolve download.proxmox.com directly to that IP.
 
  • Like
Reactions: Kingneutron and losta87
Perhaps this helps

wget http://download.proxmox.com/debian/...-amd64/pve-edk2-firmware_3.20230228-2_all.deb
--2023-05-12 10:31:59-- http://download.proxmox.com/debian/...-amd64/pve-edk2-firmware_3.20230228-2_all.deb
Auflösen des Hostnamens download.proxmox.com (download.proxmox.com)… 2402:1f00:8000:800::467, 51.79.159.216
Verbindungsaufbau zu download.proxmox.com (download.proxmox.com)|2402:1f00:8000:800::467|:80 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 10244132 (9,8M) [application/octet-stream]
Wird in »pve-edk2-firmware_3.20230228-2_all.deb« gespeichert.

pve-edk2-firmware_3.20230228-2_all.deb 3%[=> ] 318,32K 3,79KB/s ETA 39m 36s

on another host in the same Network
wget http://download.proxmox.com/debian/...-amd64/pve-edk2-firmware_3.20230228-2_all.deb
--2023-05-12 10:34:30-- http://download.proxmox.com/debian/...-amd64/pve-edk2-firmware_3.20230228-2_all.deb
Resolving download.proxmox.com (download.proxmox.com)... 212.224.123.70, 2a01:7e0:0:424::249
Connecting to download.proxmox.com (download.proxmox.com)|212.224.123.70|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 10244132 (9.8M) [application/octet-stream]
Saving to: 'pve-edk2-firmware_3.20230228-2_all.deb'

pve-edk2-firmware_3.20230228-2_all.deb 100%[=====================================================================================>] 9.77M 5.19MB/s in 1.9s

2023-05-12 10:34:32 (5.19 MB/s) - 'pve-edk2-firmware_3.20230228-2_all.deb' saved [10244132/10244132]
 
mira said:
Does it work if you access another CDN?
You can add the following to your /etc/hosts file and then run the full-upgrade again:
212.224.123.70 download.proxmox.com

It will resolve download.proxmox.com directly to that IP.
Click to expand...
Worked like a charm - you're an angel! Thanks!
 
  • Like
Reactions: Kingneutron
Thanks!

We're looking into it.
 
the sg.cdn.proxmox.com also had a very slow response when downloading the kernel pve-kernel-5.15.107-2-pve
 
mira said:
Does it work if you access another CDN?
You can add the following to your /etc/hosts file and then run the full-upgrade again:
212.224.123.70 download.proxmox.com

It will resolve download.proxmox.com directly to that IP.
Click to expand...
Now this server is slow
de.cdn.proxmox.com has address 212.224.123.70
de.cdn.proxmox.com has IPv6 address 2a01:7e0:0:424::249

68% [651 pve-qemu-kvm 10.6 MB/28.1 MB 38%] 152 kB/s 23min 42
 
Thanks for the report, checked the server and seems we got a bunch of people running recursive wget or rclone in a loop, both are highly inefficient to mirror Debian package repos, and doing it that frequently is just out of line, so I blocked a bunch of them.

We recommend Proxmox Offline Mirror for mirroring any Debian repos, and especially ours: https://pom.proxmox.com/
That is much more efficient as it's understands the package index and uses a local content addressable storage as data pool, not only saving you and us traffic, but also saving you storage space.
 
  • Like
Reactions: Kingneutron
t.lamprecht said:
We recommend Proxmox Offline Mirror for mirroring any Debian repos, and especially ours: https://pom.proxmox.com/
That is much more efficient as it's understands the package index and uses a local content addressable storage as data pool, not only saving you and us traffic, but also saving you storage space.
Click to expand...
Have you run a benchmark about that? rsync debmirror is also very fast.
 
debmirror is also quite fast as it's also package aware and thus more efficient, and it offers to download in parallel IIRC, something POM still misses (not that it helps to reduce traffic towards mirrors ;)).
Not sure anymore if Fabian, the main author of POM compared it with debmirror directly, but would be relatively easy to do, note though that I explicitly mentioned rclone and recursive wget, which both definitively ain't more efficient.

We used debmirror quite a bit, and still use it for some fewer cases. But as we run into odd issues semi-frequently, e.g., didn't like mirroring the security repo of bookworm for a while here, or needs to be triggered four times to actually have mirrored everything, without really a clue, I'm not the one administrating that so could have been naturally an issue on our side too, so we to replace our leftover internal use cases all with POM.
 
t.lamprecht said:
We used debmirror quite a bit, and still use it for some fewer cases. But as we run into odd issues semi-frequently, e.g., didn't like mirroring the security repo of bookworm for a while here, or needs to be triggered four times to actually have mirrored everything, without really a clue, I'm not the one administrating that so could have been naturally an issue on our side too, so we to replace our leftover internal use cases all with POM.
Click to expand...
I use debmirror also very frequently and just updated our mirror to support bookworm and I encountered, that I should mirror each distribution with its repective version of debmirror. We had also very strange problems with e.g. debmirror bullseye with other releases. Therefore I switch the mirroring completly to Docker and split mirroring into distributions (own directory, own Docker container image to mirror) and it runs very well. Also the sync-times are much reduced by not parsing and processing all dists at once, but only one distribution at a time.
 
  • Like
Reactions: Kingneutron and t.lamprecht
Not sure if this is useful, but I thought I'd report. I'm getting only ~300-400KB/s bandwith from download.proxmox.com resolving to 144.217.225.162. It's not an emergency, just takes longer, but not ideal.
 
trisweb said:
Not sure if this is useful, but I thought I'd report. I'm getting only ~300-400KB/s bandwith from download.proxmox.com resolving to 144.217.225.162. It's not an emergency, just takes longer, but not ideal.
Click to expand...
same here one month later
 
The enterprise repository seems to be much faster:

Code: 
root@proxmox /var/lib/vz/template/iso > wget https://enterprise.proxmox.com/iso/proxmox-ve_8.2-1.iso
--2024-08-06 16:57:11--  https://enterprise.proxmox.com/iso/proxmox-ve_8.2-1.iso
Auflösen des Hostnamens enterprise.proxmox.com (enterprise.proxmox.com)… 51.91.38.34, 2a0b:7140:5:100::167
Verbindungsaufbau zu enterprise.proxmox.com (enterprise.proxmox.com)|51.91.38.34|:443 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 1395881984 (1,3G) [application/octet-stream]
Wird in »proxmox-ve_8.2-1.iso« gespeichert.

proxmox-ve_8.2-1.iso                              100%[=====================================>]   1,30G   107MB/s    in 14s

2024-08-06 16:57:25 (96,6 MB/s) - »proxmox-ve_8.2-1.iso« gespeichert [1395881984/1395881984]
 
  • Like
Reactions: gfngfn256
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back