Upgrade issues from 5.3 to 5.4

mocanub

Active Member
Dec 12, 2018
26
0
41
39
Hello,

I've just noticed the Proxmox VE 5.3 and Debian 9 is out support starting with this month and I've been trying to upgrade my current nodes to 5.4 initially but I'm having some difficulties and I was hoping that I can get some good tips to overcome this issue:

I've updated my sources.list file so that it would contain these entries:
Code:
deb http://ftp.at.debian.org/debian stretch main contrib
deb http://ftp.at.debian.org/debian stretch-updates main contrib
# security updates
deb http://security.debian.org stretch/updates main contrib
as per the support notes from here: https://pve.proxmox.com/wiki/Downlo...Proxmox_Virtual_Environment_5.x_to_latest_5.4

This is what I get after running apt update && apt dist-upgrade:
Code:
 apparmor : Depends: python3:any
 apt-listchanges : Depends: python3:any (>= 3.5~)
 bind9-host : Depends: libisc160 (= 1:9.10.3.dfsg.P4-12.3+deb9u4) but it is not installed
 criu : Depends: libnet1 (>= 1.1.2.1) but it is not installed
 dbus : Depends: libexpat1 (>= 2.1~beta3) but it is not installed
 dh-python : Depends: python3:any (>= 3.3.2-2~)
 discover : Depends: libexpat1 (>= 2.0.1) but it is not installed
 fontconfig : Depends: fontconfig-config but it is not installed
 iamerican : Depends: ienglish-common (= 3.4.00-5) but it is not installed
 ibritish : Depends: ienglish-common (= 3.4.00-5) but it is not installed
 ifenslave : Depends: ifupdown (>= 0.7.46)
 initramfs-tools-core : Depends: klibc-utils (>= 2.0.4-8~) but it is not installed
 iptables : Depends: libnetfilter-conntrack3 but it is not installed
 isc-dhcp-client : Depends: libisc-export160 but it is not installed
 libbind9-140 : Depends: libisc160 but it is not installed
 libcairo2 : Depends: libxcb-render0 but it is not installed
 libcurl3-gnutls : Depends: libidn2-0 (>= 0.6) but it is not installed
                   Depends: libnghttp2-14 (>= 1.12.0) but it is not installed
 libdiscover2 : Depends: libexpat1 (>= 2.0.1) but it is not installed
 libdns-export162 : Depends: libisc-export160 but it is not installed
 libdns162 : Depends: libisc160 but it is not installed
 libfile-listing-perl : Depends: libhttp-date-perl but it is not installed
 libfontconfig1 : Depends: libexpat1 (>= 2.0.1) but it is not installed
                  Depends: fontconfig-config (>= 2.11.0-6.7) but it is not installed
 libhttp-cookies-perl : Depends: libhttp-date-perl but it is not installed
 libhttp-daemon-perl : Depends: libhttp-date-perl but it is not installed
 libhttp-message-perl : Depends: libhttp-date-perl but it is not installed
 libisccc140 : Depends: libisc160 but it is not installed
 libisccfg140 : Depends: libisc160 but it is not installed
 liblockfile-simple-perl : Depends: liblog-agent-perl but it is not installed
 libpsl5 : Depends: libidn2-0 (>= 0.16) but it is not installed
           Recommends: publicsuffix (>= 20150507) but it is not installed
 libpulse0 : Depends: libasyncns0 (>= 0.3) but it is not installed
 libpve-guest-common-perl : Depends: libpve-storage-perl (>= 5.0-37) but it is not installed
 libpve-http-server-perl : Depends: libhttp-date-perl but it is not installed
 libpython2.7-stdlib : Depends: libexpat1 (>= 2.1~beta3) but it is not installed
 librgw2 : Depends: libexpat1 (>= 2.0.1) but it is not installed
 librrd8 : Depends: libdbi1 (>= 0.8.4) but it is not installed
 libsmbclient : Depends: samba-libs (= 2:4.5.16+dfsg-1) but it is not installed
 libwww-perl : Depends: libhttp-date-perl but it is not installed
               Recommends: libmailtools-perl but it is not installed
 libxml-parser-perl : Depends: libexpat1 (>= 2.0.1) but it is not installed
 lsb-release : Depends: python3:any (>= 3.4~)
 lxc-pve : Depends: python3 but it is not installed
 nfs-common : Depends: libnfsidmap2 but it is not installed
 proxmox-ve : Depends: qemu-server but it is not installed
 pve-container : Depends: libpve-storage-perl (>= 5.0-31) but it is not installed
 pve-firewall : Depends: libnetfilter-conntrack3 but it is not installed
 pve-ha-manager : Depends: qemu-server but it is not installed
 pve-manager : Depends: apt-transport-https but it is not installed
               Depends: libapt-pkg-perl but it is not installed
               Depends: libpve-storage-perl (>= 5.0-35) but it is not installed
               Depends: lzop but it is not installed
               Depends: qemu-server (>= 5.0-24) but it is not installed
 python-requests : Depends: python-chardet but it is not installed
                   Depends: python-urllib3 (< 1.19.2) but 2.18-1 is installed
 python-samba : Depends: python-crypto but it is not installed
                Depends: samba-libs (= 2:4.5.16+dfsg-1) but it is not installed
 python-urllib3 : Depends: libnet-smtp-ssl-perl but it is not installed
 python3-apt : Depends: python3 (< 3.6) but it is not installed
               Depends: python3 (>= 3.5~) but it is not installed
               Depends: python3:any (>= 3.3.2-2~)
 python3-chardet : Depends: python3:any (>= 3.3.2-2~)
 python3-debian : Depends: python3:any (>= 3.3.2-2~)
 python3-httplib2 : Depends: python3:any (>= 3.3.2-2~)
 python3-pkg-resources : Depends: python3:any (>= 3.3.2-2~)
 python3-pycurl : Depends: python3 (< 3.6) but it is not installed
                  Depends: python3 (>= 3.5~) but it is not installed
                  Depends: python3:any (>= 3.3.2-2~)
 python3-pysimplesoap : Depends: python3:any (>= 3.3.2-2~)
 python3-reportbug : Depends: python3:any (>= 3.3.2-2~)
 python3-requests : Depends: python3:any (>= 3.3.2-2~)
 python3-six : Depends: python3:any (>= 3.4~)
 python3-urllib3 : Depends: python3:any (>= 3.3.2-2~)
 python3.5-minimal : Depends: libexpat1 (>= 2.1~beta3) but it is not installed
 reportbug : Depends: python3:any
 rrdcached : Depends: libdbi1 (>= 0.8.4) but it is not installed
 samba-common-bin : Depends: samba-libs (= 2:4.5.16+dfsg-1) but it is not installed
 smbclient : Depends: samba-libs (= 2:4.5.16+dfsg-1) but it is not installed
 thin-provisioning-tools : Depends: libexpat1 (>= 2.0.1) but it is not installed
N: Ignoring file 'pve-enterprise.list.off' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).

And if I try to run the apt --fix-broken install command I get this:
Code:
The following packages will be REMOVED:
  ceph-common libpve-guest-common-perl proxmox-ve pve-container pve-manager pve-qemu-kvm python-requests spiceterm
The following NEW packages will be installed:
  fontconfig-config ienglish-common ifupdown klibc-utils libasyncns0 libdbi1 libexpat1 libhttp-date-perl libidn2-0 libisc-export160 libisc160 liblog-agent-perl libmailtools-perl libnet-smtp-ssl-perl libnet1 libnetfilter-conntrack3 libnfsidmap2 libnghttp2-14 libxcb-render0 python-crypto
  python3 samba-libs
The following packages will be upgraded:
  bind9-host dbus libbind9-140 libdbus-1-3 libdns162 libisccfg140 liblwres141 libpython3.5-minimal libpython3.5-stdlib libsmbclient libwbclient0 pve-ha-manager python-samba python3-reportbug python3.5 python3.5-minimal reportbug samba-common samba-common-bin smbclient
20 upgraded, 22 newly installed, 8 to remove and 92 not upgraded.
Need to get 0 B/17.6 MB of archives.
After this operation, 57.6 MB disk space will be freed.
N: Ignoring file 'pve-enterprise.list.off' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
Do you want to continue? [Y/n] y
W: (pve-apt-hook) !! WARNING !!
W: (pve-apt-hook) You are attempting to remove the meta-package 'proxmox-ve'!
W: (pve-apt-hook)
W: (pve-apt-hook) If you really you want to permanently remove 'proxmox-ve' from your system, run the following command
W: (pve-apt-hook)       touch '/please-remove-proxmox-ve'
W: (pve-apt-hook) and repeat your apt-get/apt invocation.
W: (pve-apt-hook)
W: (pve-apt-hook) If you are unsure why 'proxmox-ve' would be removed, please verify
W: (pve-apt-hook)       - your APT repository settings
W: (pve-apt-hook)       - that you are using 'apt-get dist-upgrade' or 'apt full-upgrade' to upgrade your system
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (1)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook

It tells me that Proxmox-VE will get removed ?! This is not really what I want to achieve here. Any thoughts / suggestions would be appreciated.

Here are my environment details:
Code:
proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve)
pve-manager: 5.3-9 (running version: 5.3-9/ba817b29)
pve-kernel-4.15: 5.3-2
pve-kernel-4.15.18-11-pve: 4.15.18-33
pve-kernel-4.15.18-8-pve: 4.15.18-28
corosync: 2.4.4-pve1
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: not correctly installed
libjs-extjs: 6.0.1-2
libpve-access-control: 5.1-3
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-46
libpve-guest-common-perl: 2.0-20
libpve-http-server-perl: 2.0-11
libpve-storage-perl: not correctly installed
libqb0: 1.0.3-1~bpo9
lvm2: 2.02.168-pve6
lxc-pve: 3.1.0-3
lxcfs: 3.0.3-pve1
novnc-pve: 1.0.0-2
proxmox-widget-toolkit: 1.0-22
pve-cluster: 5.0-33
pve-container: 2.0-34
pve-docs: 5.3-2
pve-edk2-firmware: 1.20181023-1
pve-firewall: 3.0-17
pve-firmware: 2.0-6
pve-ha-manager: 2.0-6
pve-i18n: 1.0-9
pve-libspice-server1: 0.14.1-2
pve-qemu-kvm: 2.12.1-1
pve-xtermjs: 3.10.1-1
qemu-server: not correctly installed
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3

Thanks in advance,
B
 
please post the content of /etc/apt/sources.list and all files in /etc/apt/sources.list.d, as well as the output of apt update
 
Here are the contents of the sources.list file:
Code:
deb http://ftp.at.debian.org/debian stretch main contrib

deb http://ftp.at.debian.org/debian stretch-updates main contrib

# security updates
deb http://security.debian.org stretch/updates main contrib

Here are the file contents within sources.list.d:

Code:
root@is-node-26:/etc/apt/sources.list.d# ls
elastic-6.x.list  pve-enterprise.list.off  pve-install-repo.list
root@is-node-26:/etc/apt/sources.list.d# cat elastic-6.x.list
deb https://artifacts.elastic.co/packages/6.x/apt stable main
root@is-node-26:/etc/apt/sources.list.d# cat pve-install-repo.list
deb http://download.proxmox.com/debian/pve stretch pve-no-subscription
root@is-node-26:/etc/apt/sources.list.d# cat pve-enterprise.list.off
deb https://enterprise.proxmox.com/debian/pve stretch pve-enterprise

and here is the output of the apt update command:
Code:
Hit:1 http://security.debian.org stretch/updates InRelease
Hit:2 http://download.proxmox.com/debian/pve stretch InRelease
Ign:3 http://ftp.at.debian.org/debian stretch InRelease
Get:4 http://ftp.at.debian.org/debian stretch-updates InRelease [93.6 kB]
Hit:5 http://ftp.at.debian.org/debian stretch Release
Hit:7 https://artifacts.elastic.co/packages/6.x/apt stable InRelease
Fetched 93.6 kB in 0s (176 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
116 packages can be upgraded. Run 'apt list --upgradable' to see them.
N: Ignoring file 'pve-enterprise.list.off' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
W: Encountered status field in a non-version description

B
 
Code:
 python-requests : Depends: python-chardet but it is not installed
                   Depends: python-urllib3 (< 1.19.2) but 2.18-1 is installed

no idea where this version comes from, but it's not from Debian.. what does apt-cache policy python-urllib3 say?
 
This is what is says:
Code:
python-urllib3:
  Installed: 2.18-1
  Candidate: 2.18-1
  Version table:
 *** 2.18-1 100
        100 /var/lib/dpkg/status
     1.19.1-1 500
        500 http://ftp.at.debian.org/debian stretch/main amd64 Packages
N: Ignoring file 'pve-enterprise.list.off' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
 
yeah, so you installed a package from wherever and it broke your system. you can try downgrading it with apt install --reinstall python-urllib3=1.19.1-1