pve upgrade failed with error

M

Madscientist

Member
Proxmox Subscriber
Jun 25, 2022
96
9
13
today i tried to upgrade the three node cluster, one server upgrade / update is perfect, but on the second server the update failed with the following error: -

Starting system upgrade: apt-get dist-upgrade
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
libfmt7 libthrift-0.13.0 proxmox-kernel-6.5.11-7-pve-signed
proxmox-kernel-6.5.13-5-pve-signed pve-kernel-5.15.107-2-pve
pve-kernel-5.15.108-1-pve pve-kernel-5.15.83-1-pve python-pastedeploy-tpl telnet
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
proxmox-kernel-6.8.12-6-pve-signed
The following packages will be upgraded:
base-files bind9-dnsutils bind9-host bind9-libs bsdextrautils bsdutils criu eject
fdisk libavahi-client3 libavahi-common-data libavahi-common3 libblkid1 libfdisk1
libglib2.0-0 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libmount1
libnfsidmap1 libnss-systemd libpam-systemd libpve-rs-perl libpve-storage-perl
libpython3.11 libpython3.11-minimal libpython3.11-stdlib libsmartcols1
libsystemd-shared libsystemd0 libudev1 libuuid1 mount nfs-common openssh-client
openssh-server openssh-sftp-server proxmox-backup-client
proxmox-backup-file-restore proxmox-kernel-6.8 proxmox-widget-toolkit
pve-container pve-firmware pve-i18n pve-manager python3-pkg-resources
python3-setuptools python3-urllib3 python3-werkzeug python3.11 python3.11-minimal
qemu-server rsync ssh systemd systemd-sysv tzdata ucf udev util-linux
util-linux-extra uuid-runtime
61 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 1181 kB/296 MB of archives.
After this operation, 589 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2 [1181 kB]
Err:1 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2
File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 199.232.22.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
E: Failed to fetch http://security.debian.org/pool/updates/main/b/bind9/bind9-libs_9.18.33-1~deb12u2_amd64.deb File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 199.232.22.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

System not fully up to date (found 62 new packages)

starting shell
root@pve-2:~#

kindly guide to solve this problem.... i am stuck.
 
Try switching to another debian mirror, look on website which are available. Then "update" again.
 
nope same error is showing with other mirror

debian.charite.de
mirrors.iitd.ac.in
debian-mirror.sakura.ne.jp

is it something else ......... the first server updated perfectly ........ after that it stuck ...... with same error ........ i am updating a mission critical cluster .......
 
are you using some kind of proxy that might mess with the download?

if not, try

"apt clean; rm -rf /var/lib/apt/lists/*; apt update; apt full-upgrade" and post the output here..
 
  • Like
Reactions: waltar
root@pve-2:~# apt full-upgrade
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
libfmt7 libthrift-0.13.0 proxmox-kernel-6.5.11-7-pve-signed
proxmox-kernel-6.5.13-5-pve-signed pve-kernel-5.15.107-2-pve
pve-kernel-5.15.108-1-pve pve-kernel-5.15.83-1-pve python-pastedeploy-tpl telnet
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
proxmox-kernel-6.8.12-6-pve-signed
The following packages will be upgraded:
base-files bind9-dnsutils bind9-host bind9-libs bsdextrautils bsdutils criu eject
fdisk libavahi-client3 libavahi-common-data libavahi-common3 libblkid1 libfdisk1
libglib2.0-0 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libmount1
libnfsidmap1 libnss-systemd libpam-systemd libpve-rs-perl libpve-storage-perl
libpython3.11 libpython3.11-minimal libpython3.11-stdlib libsmartcols1
libsystemd-shared libsystemd0 libudev1 libuuid1 mount nfs-common openssh-client
openssh-server openssh-sftp-server proxmox-backup-client
proxmox-backup-file-restore proxmox-kernel-6.8 proxmox-widget-toolkit
pve-container pve-firmware pve-i18n pve-manager python3-pkg-resources
python3-setuptools python3-urllib3 python3-werkzeug python3.11 python3.11-minimal
qemu-server rsync ssh systemd systemd-sysv tzdata ucf udev util-linux
util-linux-extra uuid-runtime
61 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 1181 kB/296 MB of archives.
After this operation, 589 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2 [1181 kB]
Err:1 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2
File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 199.232.22.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
E: Failed to fetch http://security.debian.org/pool/updates/main/b/bind9/bind9-libs_9.18.33-1~deb12u2_amd64.deb File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 199.232.22.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

same error ....... Hash mismatch continues and this ip address changes every time i clean the cache.
 
Last edited:
did you run all the commands I asked? because "Need to get 1181 kB/296 MB of archives." doesn't sound like it ;) please run all of them and post the full output!
 
yes i run all those command, but one by one, again i am executing all of them, result is here

root@pve-2:~# apt clean; rm -rf /var/lib/apt/lists/*; apt update; apt full-upgrade
Get:1 http://ftp.debian.org/debian bookworm InRelease [151 kB]
Get:2 http://ftp.debian.org/debian bookworm-updates InRelease [55.4 kB]
Get:3 http://ftp.debian.org/debian bookworm/main amd64 Packages [8,792 kB]
Get:4 http://security.debian.org bookworm-security InRelease [48.0 kB]
Get:5 http://security.debian.org bookworm-security/main amd64 Packages [244 kB]
Get:6 https://enterprise.proxmox.com/debian/ceph-reef bookworm InRelease [1,978 B]
Get:7 https://enterprise.proxmox.com/debian/pve bookworm InRelease [1,990 B]
Get:8 https://enterprise.proxmox.com/debian/ceph-reef bookworm/enterprise amd64 Packages [51.4 kB]
Get:9 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 Packages [384 kB]
Get:10 http://security.debian.org bookworm-security/main Translation-en [145 kB]
Get:11 http://security.debian.org bookworm-security/contrib amd64 Packages [644 B]
Get:12 http://security.debian.org bookworm-security/contrib Translation-en [372 B]
Get:13 http://ftp.debian.org/debian bookworm/main Translation-en [6,109 kB]
Get:14 http://ftp.debian.org/debian bookworm/contrib amd64 Packages [54.1 kB]
Get:15 http://ftp.debian.org/debian bookworm/contrib Translation-en [48.8 kB]
Get:16 http://ftp.debian.org/debian bookworm-updates/main amd64 Packages [13.5 kB]
Get:17 http://ftp.debian.org/debian bookworm-updates/main Translation-en [16.0 kB]
Get:18 http://ftp.debian.org/debian bookworm-updates/contrib amd64 Packages [768 B]
Get:19 http://ftp.debian.org/debian bookworm-updates/contrib Translation-en [408 B]
Fetched 16.1 MB in 22s (734 kB/s)
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
61 packages can be upgraded. Run 'apt list --upgradable' to see them.
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
libfmt7 libthrift-0.13.0 proxmox-kernel-6.5.11-7-pve-signed proxmox-kernel-6.5.13-5-pve-signed pve-kernel-5.15.107-2-pve pve-kernel-5.15.108-1-pve
pve-kernel-5.15.83-1-pve python-pastedeploy-tpl telnet
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
proxmox-kernel-6.8.12-6-pve-signed
The following packages will be upgraded:
base-files bind9-dnsutils bind9-host bind9-libs bsdextrautils bsdutils criu eject fdisk libavahi-client3 libavahi-common-data libavahi-common3 libblkid1
libfdisk1 libglib2.0-0 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libmount1 libnfsidmap1 libnss-systemd libpam-systemd libpve-rs-perl
libpve-storage-perl libpython3.11 libpython3.11-minimal libpython3.11-stdlib libsmartcols1 libsystemd-shared libsystemd0 libudev1 libuuid1 mount
nfs-common openssh-client openssh-server openssh-sftp-server proxmox-backup-client proxmox-backup-file-restore proxmox-kernel-6.8 proxmox-widget-toolkit
pve-container pve-firmware pve-i18n pve-manager python3-pkg-resources python3-setuptools python3-urllib3 python3-werkzeug python3.11 python3.11-minimal
qemu-server rsync ssh systemd systemd-sysv tzdata ucf udev util-linux util-linux-extra uuid-runtime
61 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 296 MB of archives.
After this operation, 589 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://ftp.debian.org/debian bookworm/main amd64 base-files amd64 12.4+deb12u9 [70.8 kB]
Get:2 http://ftp.debian.org/debian bookworm/main amd64 bsdutils amd64 1:2.38.1-5+deb12u3 [94.4 kB]
Get:3 http://ftp.debian.org/debian bookworm/main amd64 libsmartcols1 amd64 2.38.1-5+deb12u3 [107 kB]
Get:4 http://ftp.debian.org/debian bookworm/main amd64 util-linux-extra amd64 2.38.1-5+deb12u3 [111 kB]
Get:5 http://ftp.debian.org/debian bookworm/main amd64 util-linux amd64 2.38.1-5+deb12u3 [1,177 kB]
Get:6 http://ftp.debian.org/debian bookworm/main amd64 mount amd64 2.38.1-5+deb12u3 [134 kB]
Get:7 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 libpve-rs-perl amd64 0.9.1 [2,800 kB]
Get:8 http://ftp.debian.org/debian bookworm/main amd64 libnss-systemd amd64 252.33-1~deb12u1 [164 kB]
Get:9 http://ftp.debian.org/debian bookworm/main amd64 systemd-sysv amd64 252.33-1~deb12u1 [42.5 kB]
Get:10 http://ftp.debian.org/debian bookworm/main amd64 libpam-systemd amd64 252.33-1~deb12u1 [225 kB]
Get:11 http://ftp.debian.org/debian bookworm/main amd64 libblkid1 amd64 2.38.1-5+deb12u3 [147 kB]
Get:12 http://ftp.debian.org/debian bookworm/main amd64 libuuid1 amd64 2.38.1-5+deb12u3 [28.8 kB]
Get:13 http://ftp.debian.org/debian bookworm/main amd64 libfdisk1 amd64 2.38.1-5+deb12u3 [194 kB]
Get:14 http://ftp.debian.org/debian bookworm/main amd64 libmount1 amd64 2.38.1-5+deb12u3 [166 kB]
Get:15 http://ftp.debian.org/debian bookworm/main amd64 systemd amd64 252.33-1~deb12u1 [3,036 kB]
Get:16 http://ftp.debian.org/debian bookworm/main amd64 libsystemd-shared amd64 252.33-1~deb12u1 [1,691 kB]
Get:17 http://ftp.debian.org/debian bookworm/main amd64 libsystemd0 amd64 252.33-1~deb12u1 [332 kB]
Get:18 http://ftp.debian.org/debian bookworm/main amd64 nfs-common amd64 1:2.6.2-4+deb12u1 [260 kB]
Get:19 http://ftp.debian.org/debian bookworm/main amd64 libnfsidmap1 amd64 1:2.6.2-4+deb12u1 [54.9 kB]
Get:20 http://security.debian.org bookworm-security/main amd64 rsync amd64 3.2.7-1+deb12u2 [419 kB]
Get:21 http://ftp.debian.org/debian bookworm/main amd64 ucf all 3.0043+nmu1+deb12u1 [55.3 kB]
Get:22 http://security.debian.org bookworm-security/main amd64 bind9-host amd64 1:9.18.33-1~deb12u2 [54.1 kB]
Get:23 http://ftp.debian.org/debian bookworm/main amd64 openssh-sftp-server amd64 1:9.2p1-2+deb12u4 [65.9 kB]
Get:24 http://security.debian.org bookworm-security/main amd64 bind9-dnsutils amd64 1:9.18.33-1~deb12u2 [155 kB]
Get:25 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 qemu-server amd64 8.3.6 [291 kB]
Get:26 http://ftp.debian.org/debian bookworm/main amd64 openssh-server amd64 1:9.2p1-2+deb12u4 [456 kB]
Get:27 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 libpve-storage-perl all 8.3.3 [148 kB]
Get:28 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2 [1,181 kB]
Err:28 http://security.debian.org bookworm-security/main amd64 bind9-libs amd64 1:9.18.33-1~deb12u2
File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 151.101.154.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
Get:29 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 proxmox-backup-client amd64 3.3.2-1 [3,481 kB]
Get:30 http://ftp.debian.org/debian bookworm/main amd64 openssh-client amd64 1:9.2p1-2+deb12u4 [993 kB]
Get:31 http://ftp.debian.org/debian bookworm/main amd64 libpython3.11 amd64 3.11.2-6+deb12u5 [1,988 kB]
Get:32 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 proxmox-backup-file-restore amd64 3.3.2-2 [3,301 kB]
Get:33 http://ftp.debian.org/debian bookworm/main amd64 python3.11 amd64 3.11.2-6+deb12u5 [573 kB]
Get:34 http://ftp.debian.org/debian bookworm/main amd64 libpython3.11-stdlib amd64 3.11.2-6+deb12u5 [1,797 kB]
Get:35 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 pve-firmware all 3.14-2 [154 MB]
Get:36 http://ftp.debian.org/debian bookworm/main amd64 python3.11-minimal amd64 3.11.2-6+deb12u5 [2,067 kB]
Get:37 http://ftp.debian.org/debian bookworm/main amd64 libpython3.11-minimal amd64 3.11.2-6+deb12u5 [816 kB]
Get:38 http://ftp.debian.org/debian bookworm/main amd64 uuid-runtime amd64 2.38.1-5+deb12u3 [48.2 kB]
Get:39 http://ftp.debian.org/debian bookworm/main amd64 udev amd64 252.33-1~deb12u1 [1,704 kB]
Get:40 http://ftp.debian.org/debian bookworm/main amd64 libudev1 amd64 252.33-1~deb12u1 [109 kB]
Get:41 http://ftp.debian.org/debian bookworm/main amd64 tzdata all 2024b-0+deb12u1 [298 kB]
Get:42 http://ftp.debian.org/debian bookworm/main amd64 fdisk amd64 2.38.1-5+deb12u3 [141 kB]
Get:43 http://ftp.debian.org/debian bookworm/main amd64 bsdextrautils amd64 2.38.1-5+deb12u3 [87.0 kB]
Get:44 http://ftp.debian.org/debian bookworm/main amd64 criu amd64 3.17.1-2+deb12u1 [665 kB]
Get:45 http://ftp.debian.org/debian bookworm/main amd64 eject amd64 2.38.1-5+deb12u3 [48.1 kB]
Get:46 http://ftp.debian.org/debian bookworm/main amd64 libavahi-client3 amd64 0.8-10+deb12u1 [45.8 kB]
Get:47 http://ftp.debian.org/debian bookworm/main amd64 libavahi-common3 amd64 0.8-10+deb12u1 [42.1 kB]
Get:48 http://ftp.debian.org/debian bookworm/main amd64 libavahi-common-data amd64 0.8-10+deb12u1 [107 kB]
Get:49 http://ftp.debian.org/debian bookworm/main amd64 libglib2.0-0 amd64 2.74.6-2+deb12u5 [1,403 kB]
Get:50 http://ftp.debian.org/debian bookworm/main amd64 libgstreamer1.0-0 amd64 1.22.0-2+deb12u1 [1,170 kB]
Get:51 http://ftp.debian.org/debian bookworm/main amd64 libgstreamer-plugins-base1.0-0 amd64 1.22.0-3+deb12u4 [935 kB]
Get:52 http://ftp.debian.org/debian bookworm/main amd64 python3-setuptools all 66.1.1-1+deb12u1 [522 kB]
Get:53 http://ftp.debian.org/debian bookworm/main amd64 python3-pkg-resources all 66.1.1-1+deb12u1 [296 kB]
Get:54 http://ftp.debian.org/debian bookworm/main amd64 python3-urllib3 all 1.26.12-1+deb12u1 [114 kB]
Get:55 http://ftp.debian.org/debian bookworm/main amd64 python3-werkzeug all 2.2.2-3+deb12u1 [206 kB]
Get:56 http://ftp.debian.org/debian bookworm/main amd64 ssh all 1:9.2p1-2+deb12u4 [174 kB]
Get:57 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 proxmox-kernel-6.8.12-6-pve-signed amd64 6.8.12-6 [103 MB]
Get:58 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 proxmox-kernel-6.8 all 6.8.12-6 [10.7 kB]
Get:59 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 proxmox-widget-toolkit all 4.3.4 [220 kB]
Get:60 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 pve-container all 5.2.3 [140 kB]
Get:61 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 pve-i18n all 3.3.2 [413 kB]
Get:62 https://enterprise.proxmox.com/debian/pve bookworm/pve-enterprise amd64 pve-manager all 8.3.3 [548 kB]
Fetched 294 MB in 11s (27.6 MB/s)
E: Failed to fetch http://security.debian.org/pool/updates/main/b/bind9/bind9-libs_9.18.33-1~deb12u2_amd64.deb File has unexpected size (54108 != 1180588). Mirror sync in progress? [IP: 151.101.154.132 80]
Hashes of expected file:
- SHA256:a8066ed95a36a2dccd377261ac0ae2acc14f759099fec18b3a41aa8c879512a8
- Filesize:1180588 [weak]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
 
Last edited:
something is messing with this file - are you sure you don't have a (caching) proxy that has a corrupt copy or is otherwise messing with it?
 
no we do not use any proxy, only arista firewall is there, if "are you sure you don't have a (caching) proxy that has a corrupt copy or is otherwise messing with it?" this is true, then how the first server updated perfectly without any problem ? now i am not trying the third server, unless it got sorted out.
 
this is almost certainly an issue on your end, and since it triggers over and over again, something must be truncating that file.. you can try downloading it manually and verifying the hashsum and length, if those check out you could put it into /var/cache/apt/archives and retry the "apt full-upgrade"
 
Create a test vm and install pve inside and then update this ... what happen ?
 
today night the server updated without the error, the error suddenly vanished, i just run the said command just for testing before downloading the corrupt file from repo. and this time it done without a error, but i am unable to find out any clue what went wrong for past two days .... is it be ISP related problem .... i have no clue , can it be possible to find out from log ... what went wrong for past two days ? any idea .? .... i am planning the third server upgrade on next in few days.
 
  • Like
Reactions: waltar
like I said, it is very likely something on the path between you and the mirror (e.g. some security box or proxy) or the mirror node that that particular server was hitting (the Debian repositories are served by a CDN, so sometimes a corrupt cache on that end can be very localized and take a bit to clear up).
 
ok thanks a lot for the information and help ...... i have request to proxmox team, if possible in future release add somekind of menu to clear cache and old resudual files from the installation, that will be helpfull for many of us ..... thanks ....
 
that command already exists - I gave it to you above. we have no control over the Debian repository or its CDN..
 
sorry , u misunderstand me .... i am not asking for debian , i am asking for a option to clean the old resudual files in the installation or left over files which is occupied the space etc to clean them..... in cli it like apt get "autoclean or autoremove" in a somekind of menu for junior administrators. if in future release, like there is option for update and upgrade in proxmox menu already available.
 
apt already removes the package files after installation automatically in the default config, and it does tell you to run "apt autoremove" if there are autoremovable packages, so.. I don't think there is much to gain there?
 
he following packages were automatically installed and are no longer required:
libfmt7 libthrift-0.13.0 proxmox-kernel-6.5.11-7-pve-signed proxmox-kernel-6.5.13-5-pve-signed pve-kernel-5.15.107-2-pve pve-kernel-5.15.108-1-pve
pve-kernel-5.15.83-1-pve python-pastedeploy-tpl telnet
Use 'apt autoremove' to remove them.

i know it, but if there is a menu it will help the new commer, i have no problem in cli, but now a days the new commers just refuse to use cli ... asking for gui.... as i am retiring from work ..... does not matter ......thanks a lot
 
You must log in or register to reply here.
Top Bottom