Upgrade from 6.4 to 7.1 issue

giuppy

Member
Dec 10, 2020
29
0
6
46
In a cluster I updated all nodes but one (Enterprise repo). On this specific node when finalizing the upgrade I am getting the following message:

Code:
root@pve2:~# apt dist-upgrade
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  bsdmainutils libcroco3 libleveldb1d liboath0 librabbitmq4 librdkafka1 librgw2
  libzpool4linux proxmox-backup-file-restore proxmox-backup-restore-image
  pve-kernel-5.4.101-1-pve pve-kernel-5.4.103-1-pve python3-ceph-argparse
  python3-ceph-common python3-yaml
Use 'apt autoremove' to remove them.
The following packages will be REMOVED:
  ceph-common libacl1-dev libattr1-dev libc6-dev libglusterfs-dev libldb1
  libpve-guest-common-perl libpve-storage-perl libpython-stdlib proxmox-ve
  pve-container pve-ha-manager pve-manager pve-qemu-kvm python python-cephfs
  python-certifi python-chardet python-configparser python-future python-idna
  python-ipaddr python-minimal python-prettytable python-protobuf python-rados
  python-rbd python-requests python-talloc python-urllib3 python3-cephfs
  python3-rados python3-rbd python3-rgw qemu-server spiceterm
The following NEW packages will be installed:
  alsa-topology-conf alsa-ucm-conf bind9-dnsutils bind9-libs bsdextrautils
  distro-info-data gcc-10-base gnutls-bin libapt-pkg6.0 libbpf0 libbrotli1
  libc-devtools libcbor0 libcrypt1 libdeflate0 libdns-export1110 libdns1110
  libevent-2.1-7 libffi7 libfido2-1 libgcc-s1 libgd3 libgdk-pixbuf-2.0-0
  libgdk-pixbuf-xlib-2.0-0 libglusterd0 libgnutls-dane0 libhogweed6 libicu67
  libinih1 libip4tc2 libip6tc2 libipset13 libisc-export1105 libisc1105 libjson-c5
  libldb2 liblinear4 libmaxminddb0 libmd0 libmpdec3 libnetaddr-ip-perl libnettle8
  libnozzle1 libnsl2 libnss-nis libnss-nisplus libopeniscsiusr libopts25
  libperl4-corelibs-perl libperl5.32 libprocps8 libprotobuf23 libpve-rs-perl
  libpython3.9 libpython3.9-minimal libpython3.9-stdlib libqb100 libreadline8
  libsocket6-perl libunbound8 libuv1 libxpm4 libxxhash0 libzpool5linux logsave
  lua-lpeg mailcap manpages-dev media-types ncal os-prober pci.ids
  perl-modules-5.32 python3-ldb python3-protobuf python3-talloc python3.9
  python3.9-minimal runit-helper systemd-timesyncd
The following packages will be upgraded:
  adwaita-icon-theme apparmor apt apt-listchanges apt-utils at-spi2-core attr
  base-files base-passwd bash bash-completion bc bind9-host bridge-utils bsd-mailx
  bsdmainutils bsdutils btrfs-progs busybox bzip2 ca-certificates cifs-utils
  console-setup console-setup-linux coreutils corosync cpio criu cron curl dash
  dbus dbus-user-session dconf-gsettings-backend dconf-service debconf debconf-i18n
  debian-archive-keyring debian-faq debianutils diffutils dirmngr dmeventd
  dmidecode dmsetup dnsutils doc-debian dosfstools dpkg dtach e2fsprogs ebtables
  efibootmgr eject faketime fdisk fdutils file findutils fontconfig
  fontconfig-config fonts-dejavu-core fonts-font-awesome fonts-glyphicons-halflings
  fuse gdbm-l10n gdisk genisoimage gettext-base glib-networking
  glib-networking-common glib-networking-services glusterfs-client glusterfs-common
  gnupg gnupg-l10n gnupg-utils gpg gpg-agent gpg-wks-client gpg-wks-server gpgconf
  gpgsm gpgv grep groff-base grub-common grub-efi-amd64-bin grub-efi-ia32-bin
  grub-pc grub-pc-bin grub2-common gsettings-desktop-schemas gtk-update-icon-cache
  gzip hdparm hostname idn ifupdown2 init init-system-helpers initramfs-tools
  initramfs-tools-core iproute2 ipset iptables iputils-ping isc-dhcp-client
  isc-dhcp-common iso-codes kbd keyboard-configuration keyutils klibc-utils kmod
  krb5-locales ksm-control-daemon less libacl1 libaio1 libanyevent-http-perl
  libanyevent-perl libapparmor1 libappconfig-perl libapt-pkg-perl libarchive13
  libasound2 libasound2-data libassuan0 libasyncns0 libatk-bridge2.0-0 libatk1.0-0
  libatk1.0-data libatspi2.0-0 libattr1 libaudit-common libaudit1
  libauthen-pam-perl libavahi-client3 libavahi-common-data libavahi-common3
  libbabeltrace1 libbind9-161 libblas3 libblkid1 libbsd0 libbz2-1.0 libc-bin
  libc-dev-bin libc-l10n libc6 libcaca0 libcairo-gobject2 libcairo2 libcap-ng0
  libcap2 libcap2-bin libcfg7 libclone-perl libcmap4 libcolord2 libcom-err2
  libcommon-sense-perl libconvert-asn1-perl libcorosync-common4 libcpg4
  libcrypt-openssl-bignum-perl libcrypt-openssl-random-perl
  libcrypt-openssl-rsa-perl libcrypt-random-seed-perl libcrypt-ssleay-perl
  libcryptsetup12 libcups2 libcurl3-gnutls libcurl4 libdatrie1 libdb5.3 libdbi1
  libdbus-1-3 libdconf1 libdebconfclient0 libdevmapper-event1.02.1
  libdevmapper1.02.1 libdigest-hmac-perl libdw1 libedit2 libefiboot1 libefivar1
  libelf1 libencode-locale-perl libepoxy0 libestr0 libev4 libexpat1 libext2fs2
  libfaketime libfastjson4 libfdisk1 libfile-chdir-perl libfile-listing-perl
  libfilesys-df-perl libflac8 libfontconfig1 libfreetype6 libfribidi0 libfstrm0
  libfuse2 libfuse3-3 libgcrypt20 libgdbm-compat4 libgdbm6 libgdk-pixbuf2.0-0
  libgdk-pixbuf2.0-bin libgdk-pixbuf2.0-common libgeoip1 libgfapi0 libgfchangelog0
  libgfortran5 libgfrpc0 libgfxdr0 libglib2.0-0 libglusterfs0 libgmp10 libgnutls30
  libgnutlsxx28 libgoogle-perftools4 libgpg-error0 libgraphite2-3 libgssapi-krb5-2
  libgssrpc4 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libgtk-3-0
  libgtk-3-bin libgtk-3-common libharfbuzz0b libhtml-parser-perl
  libhtml-tagset-perl libhttp-cookies-perl libhttp-daemon-perl libhttp-date-perl
  libhttp-message-perl libibverbs1 libice6 libidn11 libidn2-0 libio-html-perl
  libio-multiplex-perl libio-socket-ssl-perl libiptc0 libirs161 libisccc161
  libisccfg163 libiscsi7 libisns0 libjansson4 libjemalloc2 libjpeg62-turbo
  libjs-bootstrap libjs-extjs libjs-jquery libjs-sphinxdoc libjs-underscore
  libjson-glib-1.0-0 libjson-glib-1.0-common libjson-perl libjson-xs-perl
  libk5crypto3 libkeyutils1 libklibc libkmod2 libknet1 libkrad0 libkrb5-3
  libkrb5support0 libksba8 liblcms2-2 libldap-2.4-2 libldap-common libleveldb1d
  liblinux-inotify2-perl liblmdb0 liblocale-gettext-perl liblockfile-bin
  liblockfile1 liblognorm5 liblttng-ust-ctl4 liblttng-ust0 liblua5.3-0
  liblvm2cmd2.03 liblwp-mediatypes-perl liblwp-protocol-https-perl liblwres161
  liblz4-1 liblzma5 liblzo2-2 libmagic-mgc libmagic1 libmath-random-isaac-perl
  libmime-base32-perl libmnl0 libmount1 libncurses6 libncursesw6 libnet-dbus-perl
  libnet-dns-perl libnet-http-perl libnet-ldap-perl libnet-ssleay-perl
  libnetfilter-conntrack3 libnetfilter-log1 libnewt0.52 libnfsidmap2 libnftnl11
  libnghttp2-14 libnl-3-200 libnl-route-3-200 libnpth0 libnspr4 libnss-systemd
  libnss3 libnuma1 libnvpair3linux liboath0 libogg0 libopus0 liborc-0.4-0
  libp11-kit0 libpam-modules libpam-modules-bin libpam-runtime libpam-systemd
  libpam0g libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libpcap0.8 libpci3
  libpcre2-8-0 libpcre3 libpipeline1 libpixman-1-0 libpng16-16 libpopt0
  libprotobuf-c1 libproxmox-acme-perl libproxmox-acme-plugins
  libproxmox-backup-qemu0 libproxy1v5 libpsl5 libpulse0 libpve-access-control
  libpve-apiclient-perl libpve-cluster-api-perl libpve-cluster-perl
  libpve-common-perl libpve-http-server-perl libpve-u2f-server-perl
  libpython2-stdlib libpython2.7 libpython2.7-minimal libpython2.7-stdlib
  libpython3-stdlib libqrencode4 libquadmath0 libquorum5 librabbitmq4
  librados2-perl librdkafka1 librdmacm1 librest-0.7-0 librrd8 librrds-perl
  librsvg2-2 librsvg2-common librtmp1 libsasl2-2 libsasl2-modules-db
  libsdl1.2debian libseccomp2 libselinux1 libsemanage-common libsemanage1 libsepol1
  libslang2 libsmartcols1 libsmbclient libsnappy1v5 libsndfile1 libsoup-gnome2.4-1
  libsoup2.4-1 libspice-server1 libsqlite3-0 libss2 libssh2-1 libssl1.1
  libstatgrab10 libstdc++6 libsystemd0 libtalloc2 libtasn1-6 libtcmalloc-minimal4
  libtdb1 libtemplate-perl libterm-readline-gnu-perl libtevent0
  libtext-charwidth-perl libtext-iconv-perl libtext-wrapi18n-perl libthai-data
  libthai0 libtiff5 libtimedate-perl libtinfo6 libtirpc-common libtirpc3
  libtypes-serialiser-perl libu2f-server0 libuchardet0 libudev1 libunistring2
  libunwind8 liburcu6 liburi-perl libusb-1.0-0 libusbredirparser1 libuuid-perl
  libuuid1 libuutil3linux libverto-libev1 libverto1 libvorbis0a libvorbisenc2
  libvotequorum8 libwayland-client0 libwayland-cursor0 libwayland-egl1 libwbclient0
  libwebp6 libwrap0 libwww-perl libx11-6 libx11-data libx11-xcb1 libxau6
  libxcb-render0 libxcb-shm0 libxcb1 libxcomposite1 libxcursor1 libxdamage1
  libxext6 libxfixes3 libxi6 libxkbcommon0 libxml-libxml-perl
  libxml-namespacesupport-perl libxml-parser-perl libxml-sax-base-perl
  libxml-sax-perl libxml-twig-perl libxml2 libxslt1.1 libxtables12 libyaml-0-2
  libyaml-libyaml-perl libzfs4linux libzstd1 linux-libc-dev locales login logrotate
  lrzsz lsb-base lsof lvm2 lxc-pve lxcfs lynx lynx-common lzop man-db manpages mawk
  memtest86+ mime-support minicom mount nano ncurses-base ncurses-bin ncurses-term
  netbase netcat-traditional nfs-common nmap nmap-common novnc-pve numactl
  open-iscsi openssh-client openssh-server openssh-sftp-server openssl passwd patch
  pciutils perl perl-base perl-openssl-defaults pinentry-curses postfix procps
  proxmox-archive-keyring proxmox-backup-client proxmox-backup-file-restore
  proxmox-backup-restore-image proxmox-mini-journalreader proxmox-widget-toolkit
  psmisc putty putty-tools pve-cluster pve-docs pve-edk2-firmware pve-firewall
  pve-firmware pve-i18n pve-kernel-helper pve-lxc-syscalld pve-xtermjs
  python-apt-common python-pkg-resources python-six python2 python2-minimal
  python2.7 python2.7-minimal python3 python3-apt python3-certifi python3-chardet
  python3-debconf python3-debian python3-debianbts python3-httplib2 python3-idna
  python3-jwt python3-minimal python3-pkg-resources python3-prettytable
  python3-pycurl python3-pysimplesoap python3-reportbug python3-requests
  python3-six python3-urllib3 python3-yaml qrencode readline-common reportbug
  rpcbind rrdcached rsync rsyslog samba-common samba-libs sensible-utils
  shared-mime-info smbclient socat spl sqlite3 ssh ssl-cert strace systemd
  systemd-sysv sysvinit-utils tar tasksel tasksel-data tcpdump telnet
  thin-provisioning-tools time traceroute tzdata ucf udev uidmap usb.ids usbutils
  util-linux vim-common vim-tiny vncterm wamerican wget whiptail x11-common
  xfsprogs xkb-data xsltproc xxd xz-utils zfs-initramfs zfs-zed zfsutils-linux
  zlib1g zstd
611 upgraded, 80 newly installed, 36 to remove and 0 not upgraded.
Need to get 0 B/373 MB of archives.
After this operation, 32.8 MB disk space will be freed.
Do you want to continue? [Y/n] Y
W: (pve-apt-hook) !! WARNING !!
W: (pve-apt-hook) You are attempting to remove the meta-package 'proxmox-ve'!
W: (pve-apt-hook)
W: (pve-apt-hook) If you really want to permanently remove 'proxmox-ve' from your system, run the following command
W: (pve-apt-hook)       touch '/please-remove-proxmox-ve'
W: (pve-apt-hook) run apt purge proxmox-ve to remove the meta-package
W: (pve-apt-hook) and repeat your apt invocation.
W: (pve-apt-hook)
W: (pve-apt-hook) If you are unsure why 'proxmox-ve' would be removed, please verify
W: (pve-apt-hook)       - your APT repository settings
W: (pve-apt-hook)       - that you are using 'apt full-upgrade' to upgrade your system
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (1)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook
Obviously I don't want to permanently remove 'proxmox-ve' from the system and ceph is not in use in any of the node in the cluster.
Any idea?
Thanks, Giuseppe
 
Last edited by a moderator:
Hi,

can you please post the output of the following commands to get a better overview of the package manager state:
Bash:
pveversion -v
head -n -0 /etc/apt/sources.list /etc/apt/sources.list.d/*
apt update
 
Hi, sure, here it is

Code:
proxmox-ve: 6.4-1 (running kernel: 5.4.162-1-pve)
pve-manager: 6.4-13 (running version: 6.4-13/9f411e79)
pve-kernel-5.4: 6.4-12
pve-kernel-helper: 6.4-12
pve-kernel-5.4.162-1-pve: 5.4.162-2
pve-kernel-5.4.114-1-pve: 5.4.114-1
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.4.101-1-pve: 5.4.101-1
pve-kernel-5.4.73-1-pve: 5.4.73-1
ceph-fuse: 15.2.15-pve1~bpo10
corosync: 3.1.5-pve2~bpo10+1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve4~bpo10
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.22-pve2~bpo10+1
libproxmox-acme-perl: 1.1.0
libproxmox-backup-qemu0: 1.1.0-1
libpve-access-control: 6.4-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.4-4
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.2-3
libpve-storage-perl: 6.4-1
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.1.13-2
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.6-1
pve-cluster: 6.4-1
pve-container: 3.3-6
pve-docs: 6.4-2
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-4
pve-firmware: 3.3-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-6
pve-xtermjs: 4.7.0-3
root@pve2:~# apt update
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.7-pve1
root@pve2:~# head -n -0 /etc/apt/sources.list /etc/apt/sources.list.d/*
==> /etc/apt/sources.list <==
deb http://ftp.it.debian.org/debian bullseye main contrib

deb http://ftp.it.debian.org/debian bullseye-updates main contrib

#deb http://download.proxmox.com/debian/pve bullseye pve-no-subscription
#deb https://enterprise.proxmox.com/debian/pve bullseye pve-enterprise


# security updates
deb http://security.debian.org bullseye-security main contrib

==> /etc/apt/sources.list.d/ceph.list <==
deb http://download.proxmox.com/debian/ceph-octopus buster main

==> /etc/apt/sources.list.d/pve-enterprise.list <==
deb https://enterprise.proxmox.com/debian/pve bullseye pve-enterprise
 
==> /etc/apt/sources.list.d/ceph.list <==
deb http://download.proxmox.com/debian/ceph-octopus buster main
Your ceph.list still refers to the 6.x buster, so you'd need to change that to bullseye (octopus is still fine there), then run apt update again and retry the dist upgrade.

Running the pve6to7 upgrade checker script should have noticed you on that though.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!