I have a 3 node cluster that is having this error.
It was ISO from proxmox, never debian, so no linux kernel packages besides pve's.
They did have a testing ceph installed ONCE, but never utilized, i removed everything on it.
I did try to add the repos back and do the upgrades again, but that did not work.
It was ISO from proxmox, never debian, so no linux kernel packages besides pve's.
They did have a testing ceph installed ONCE, but never utilized, i removed everything on it.
I did try to add the repos back and do the upgrades again, but that did not work.
Code:
root@pve1:/var/lib# pveversion -v
proxmox-ve: 7.4-1 (running kernel: 5.15.108-1-pve)
pve-manager: 7.4-15 (running version: 7.4-15/a5d2a31e)
pve-kernel-5.15: 7.4-4
pve-kernel-5.15.108-1-pve: 5.15.108-1
pve-kernel-5.15.107-2-pve: 5.15.107-2
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph: 17.2.6-pve1
ceph-fuse: 17.2.6-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx4
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.4
libproxmox-backup-qemu0: 1.3.1-1
libproxmox-rs-perl: 0.2.1
libpve-access-control: 7.4.1
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.4-2
libpve-guest-common-perl: 4.2-4
libpve-http-server-perl: 4.2-3
libpve-rs-perl: 0.7.7
libpve-storage-perl: 7.4-3
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.2-2
lxcfs: 5.0.3-pve1
novnc-pve: 1.4.0-1
proxmox-backup-client: 2.4.2-1
proxmox-backup-file-restore: 2.4.2-1
proxmox-kernel-helper: 7.4-1
proxmox-mail-forward: 0.1.1-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.7.3
pve-cluster: 7.3-3
pve-container: 4.4-6
pve-docs: 7.4-2
pve-edk2-firmware: 3.20230228-4~bpo11+1
pve-firewall: 4.3-4
pve-firmware: 3.6-5
pve-ha-manager: 3.6.1
pve-i18n: 2.12-1
pve-qemu-kvm: 7.2.0-8
pve-xtermjs: 4.16.0-2
qemu-server: 7.4-4
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+3
vncterm: 1.7-1
zfsutils-linux: 2.1.11-pve1
Code:
root@pve1:/var/lib# grep '' /etc/apt/sources.list* /etc/apt/sources.list.d/*
/etc/apt/sources.list:#Ansible managed: Last modified on 2022-12-02 18:37:21 by deploy
/etc/apt/sources.list:deb http://ftp.debian.org/debian bookworm main contrib non-free
/etc/apt/sources.list:deb http://ftp.debian.org/debian bookworm-updates main
/etc/apt/sources.list:deb http://ftp.debian.org/debian bookworm-backports main
/etc/apt/sources.list:
/etc/apt/sources.list:
/etc/apt/sources.list:deb https://security.debian.org/ bookworm-security main contrib non-free
/etc/apt/sources.list:
grep: /etc/apt/sources.list.d: Is a directory
/etc/apt/sources.list.d/pve-no-subscription.list:deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription
/etc/apt/sources.list.d/pve-no-subscription.list:
Code:
root@pve1:/var/lib# apt dist-upgrade
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
ceph-mgr-modules-core g++-10 libjs-sencha-touch libpython3.9-dev libslirp0 libsqlite3-mod-ceph libstdc++-10-dev libtiff5 libwebp6 proxmox-kernel-helper proxmox-mail-forward python-pastedeploy-tpl python-pip-whl
python3-autocommand python3-bcrypt python3-bs4 python3-cheroot python3-cherrypy3 python3-dateutil python3-inflect python3-jaraco.classes python3-jaraco.collections python3-jaraco.context python3-jaraco.functools
python3-jaraco.text python3-logutils python3-more-itertools python3-natsort python3-paste python3-pastedeploy python3-pastedeploy-tpl python3-pecan python3-portend python3-simplegeneric python3-singledispatch python3-soupsieve
python3-tempita python3-tempora python3-tz python3-waitress python3-webob python3-webtest python3-werkzeug python3-zc.lockfile python3.9-dev telnet
Use 'apt autoremove' to remove them.
The following packages will be REMOVED:
ceph ceph-base ceph-common ceph-mds ceph-mgr ceph-mon ceph-osd ceph-volume libgnutlsxx28 libnfsidmap2 libpve-guest-common-perl libpve-storage-perl libsemanage1 proxmox-ve pve-container pve-ha-manager pve-manager pve-qemu-kvm
python3-cephfs python3-rados python3-rbd python3-rgw qemu-server spiceterm
The following NEW packages will be installed:
cpp-12 cron-daemon-common dbus-bin dbus-daemon dbus-session-bus-common dbus-system-bus-common dbus-user-session freeipmi-common g++-12 gcc-11-base gcc-12 gcc-12-base i965-va-driver inetutils-telnet intel-media-va-driver ipmitool
jq libabsl20220623 libaom3 libasan8 libavif15 libbpf1 libcbor0.8 libdav1d6 libde265-0 libdrm-amdgpu1 libdrm-intel1 libdrm-nouveau2 libdrm-radeon1 libevent-core-2.1-7 libffi8 libfile-find-rule-perl libflac12 libfreeipmi17
libgav1-1 libgcc-12-dev libgnutlsxx30 libgprofng0 libheif1 libicu72 libigdgmm12 libjq1 libldap-2.5-0 libldap-common liblerc4 libllvm15 libmp3lame0 libmpg123-0 libnet-libidn2-perl libnfsidmap1 libnumber-compare-perl libnvme1
libonig5 libopenipmi0 libpciaccess0 libperl5.36 libproc2-0 libprotobuf32 libpython3.11 libpython3.11-dev libpython3.11-minimal libpython3.11-stdlib librav1e0 libregexp-ipv6-perl libsemanage2 libsensors-config libsensors5
libsepol2 libsnmp-base libsnmp40 libssl3 libstdc++-12-dev libsubid4 libsvtav1enc1 libsystemd-shared libtext-glob-perl libtiff6 libtsan2 liburcu8 libva-drm2 libva2 libvulkan1 libwayland-client0 libwebp7 libx11-xcb1 libx265-199
libxcb-dri2-0 libxcb-dri3-0 libxcb-present0 libxcb-randr0 libxcb-sync1 libxcb-xfixes0 libxshmfence1 libyuv0 libz3-4 mesa-va-drivers mesa-vulkan-drivers openipmi perl-modules-5.36 python3-autocommand python3-charset-normalizer
python3-cheroot python3-inflect python3-jaraco.classes python3-jaraco.collections python3-jaraco.context python3-jaraco.functools python3-jaraco.text python3-more-itertools python3-pastedeploy-tpl python3-portend
python3-pyparsing python3-systemd python3-tempora python3-tz python3-wcwidth python3-zc.lockfile python3.11 python3.11-dev python3.11-minimal rpcsvc-proto sgml-base usrmerge util-linux-extra va-driver-all
The following packages will be upgraded:
adduser apparmor apt apt-transport-https apt-utils aptitude aptitude-common attr base-files base-passwd bash bash-completion bc bind9-dnsutils bind9-host bind9-libs binutils binutils-common binutils-x86-64-linux-gnu bridge-utils
bsd-mailx bsdextrautils bsdutils btrfs-progs busybox bwm-ng bzip2 ca-certificates chrony cifs-utils console-setup console-setup-linux coreutils corosync cpio cpp criu cron cryptsetup-bin cstream curl dash dbus debconf
debconf-i18n debian-archive-keyring debian-faq debianutils diffutils dirmngr distro-info-data dmeventd dmidecode dmsetup doc-debian dpkg dpkg-dev e2fsprogs ebtables efibootmgr eject ethtool fakeroot faketime fdisk fdutils file
findutils fontconfig fontconfig-config fonts-dejavu-core fonts-glyphicons-halflings fuse g++ gcc gdisk genisoimage gettext-base gir1.2-glib-2.0 glusterfs-client glusterfs-common gnupg gnupg-l10n gnupg-utils gnutls-bin gpg
gpg-agent gpg-wks-client gpg-wks-server gpgconf gpgsm gpgv grep groff-base grub-common grub-efi-amd64-bin grub-pc grub-pc-bin grub2-common gzip haveged hdparm hostname htop ifupdown2 init init-system-helpers initramfs-tools
initramfs-tools-core iotop iperf3 iproute2 ipset iptables iputils-ping isc-dhcp-client isc-dhcp-common iso-codes kbd keyboard-configuration keyutils klibc-utils kmod krb5-locales less libacl1 libaio1 libalgorithm-diff-xs-perl
libalgorithm-merge-perl libanyevent-http-perl libanyevent-perl libapparmor1 libappconfig-perl libapt-pkg-perl libapt-pkg6.0 libarchive13 libargon2-1 libasan6 libasound2 libasound2-data libassuan0 libasyncns0 libatomic1 libattr1
libaudit-common libaudit1 libauthen-pam-perl libavahi-client3 libavahi-common-data libavahi-common3 libbabeltrace1 libbinutils libblas3 libblkid1 libboost-iostreams1.74.0 libbrotli1 libbsd0 libbytes-random-secure-perl libbz2-1.0
libc-bin libc-dev-bin libc-devtools libc-l10n libc6 libc6-dev libcairo2 libcap-ng0 libcap2 libcap2-bin libcc1-0 libcfg7 libclone-perl libcmap4 libcom-err2 libcommon-sense-perl libconvert-asn1-perl libcorosync-common4 libcpg4
libcrypt-dev libcrypt-openssl-bignum-perl libcrypt-openssl-random-perl libcrypt-openssl-rsa-perl libcrypt-random-seed-perl libcrypt-ssleay-perl libcrypt1 libcryptsetup12 libctf-nobfd0 libctf0 libcups2 libcurl3-gnutls libcurl4
libcwidget4 libdatrie1 libdb5.3 libdbus-1-3 libdebconfclient0 libdeflate0 libdevel-cycle-perl libdevmapper-event1.02.1 libdevmapper1.02.1 libdigest-hmac-perl libdouble-conversion3 libdpkg-perl libdrm-common libdrm2 libdw1
libedit2 libelf1 libencode-locale-perl libepoxy0 libestr0 libevent-2.1-7 libexpat1 libexpat1-dev libext2fs2 libfakeroot libfaketime libfastjson4 libfdisk1 libfdt1 libfido2-1 libfile-fcntllock-perl libfile-listing-perl
libfile-readbackwards-perl libfilesys-df-perl libfontconfig1 libfreetype6 libfribidi0 libfstrm0 libfuse2 libfuse3-3 libgbm1 libgcc-s1 libgcrypt20 libgd3 libgdbm-compat4 libgdbm6 libgfapi0 libgfchangelog0 libgfrpc0 libgfxdr0
libgirepository-1.0-1 libglib2.0-0 libglusterd0 libglusterfs0 libgmp10 libgnutls-dane0 libgnutls30 libgomp1 libgoogle-perftools4 libgpg-error0 libgssapi-krb5-2 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libharfbuzz0b
libhavege2 libhogweed6 libhtml-parser-perl libhtml-tagset-perl libhtml-tree-perl libhttp-daemon-perl libhttp-date-perl libhttp-message-perl libhttp-negotiate-perl libibverbs1 libidn2-0 libinih1 libio-html-perl
libio-multiplex-perl libio-pty-perl libio-socket-ssl-perl libip4tc2 libip6tc2 libipc-run-perl libiperf0 libipset13 libisl23 libisns0 libitm1 libjansson4 libjbig0 libjemalloc2 libjpeg62-turbo libjs-bootstrap libjs-extjs
libjs-jquery libjs-qrcodejs libjs-sphinxdoc libjs-underscore libjson-c5 libjson-glib-1.0-0 libjson-glib-1.0-common libjson-perl libjson-xs-perl libk5crypto3 libkeyutils1 libklibc libkmod2 libknet1 libkrb5-3 libkrb5support0
libksba8 libldb2 libleveldb1d liblinux-inotify2-perl liblocale-gettext-perl liblognorm5 liblsan0 liblua5.3-0 liblvm2cmd2.03 liblwp-mediatypes-perl liblz4-1 liblzma5 libmagic-mgc libmagic1 libmath-random-isaac-perl libmaxminddb0
libmd0 libmime-base32-perl libmount1 libmpc3 libmpfr6 libncurses6 libncursesw6 libnet-dbus-perl libnet-dns-perl libnet-http-perl libnet-ip-perl libnet-ssleay-perl libnet1 libnetaddr-ip-perl libnetfilter-conntrack3
libnetfilter-log1 libnettle8 libnewt0.52 libnfnetlink0 libnftables1 libnftnl11 libnghttp2-14 libnl-3-200 libnl-genl-3-200 libnl-route-3-200 libnozzle1 libnspr4 libnss-systemd libnss3 libnuma1 libnvpair3linux liboath0 libogg0
libopeniscsiusr libopts25 libopus0 liborc-0.4-0 libp11-kit0 libpam-modules libpam-modules-bin libpam-runtime libpam-systemd libpam0g libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libparted2 libpcap0.8 libpci3 libpcre2-16-0
libpcre2-8-0 libpcre3 libpipeline1 libpixman-1-0 libpng16-16 libpopt0 libposix-strptime-perl libprotobuf-c1 libproxmox-acme-perl libproxmox-acme-plugins libproxmox-backup-qemu0 libproxmox-rs-perl libpsl5 libpulse0
libpve-access-control libpve-apiclient-perl libpve-cluster-api-perl libpve-cluster-perl libpve-common-perl libpve-http-server-perl libpve-rs-perl libpve-u2f-server-perl libpython3-dev libpython3-stdlib libqb100 libqt5core5a
libqt5dbus5 libqt5network5 libquadmath0 libquorum5 librabbitmq4 librados2-perl librdkafka1 librdmacm1 libreadline8 librrd8 librrds-perl libsasl2-2 libsasl2-modules-db libsctp1 libseccomp2 libselinux1 libsemanage-common
libsigc++-2.0-0v5 libslang2 libslirp0 libsmartcols1 libsmbclient libsnappy1v5 libsndfile1 libspice-server1 libsqlite3-0 libss2 libssh2-1 libstatgrab10 libstdc++6 libstring-shellquote-perl libsystemd0 libtalloc2 libtasn1-6
libtcmalloc-minimal4 libtdb1 libtemplate-perl libterm-readline-gnu-perl libtevent0 libtext-charwidth-perl libtext-iconv-perl libtext-wrapi18n-perl libthai-data libthai0 libtime-duration-perl libtinfo6 libtirpc-common libtirpc-dev
libtirpc3 libtpms0 libtry-tiny-perl libtsan0 libu2f-server0 libubsan1 libudev1 libunbound8 libunistring2 libunwind8 liburi-perl libusb-1.0-0 libusbredirparser1 libuuid-perl libuuid1 libuutil3linux libuv1 libvirglrenderer1
libvotequorum8 libwayland-server0 libwbclient0 libwrap0 libwww-perl libx11-6 libx11-data libxapian30 libxcb-render0 libxcb-shm0 libxcb1 libxext6 libxml-libxml-perl libxml-namespacesupport-perl libxml-parser-perl
libxml-sax-base-perl libxml-sax-perl libxml-twig-perl libxml2 libxpm4 libxrender1 libxslt1.1 libxtables12 libxxhash0 libyaml-0-2 libyaml-libyaml-perl libzfs4linux libzpool5linux libzstd1 linux-base linux-libc-dev locales login
logrotate logsave lsb-base lsb-release lsof lua-lpeg lvm2 lxc-pve lxcfs mailcap man-db manpages manpages-dev mawk media-types memtest86+ moreutils mount nano ncdu ncurses-base ncurses-bin ncurses-term net-tools netbase
netcat-traditional nfs-common nftables nmap nmap-common novnc-pve nvme-cli open-iscsi openssh-client openssh-server openssh-sftp-server openssl parted passwd pci.ids pciutils perl perl-base perl-openssl-defaults pinentry-curses
postfix procmail procps prometheus-node-exporter prometheus-node-exporter-collectors proxmox-archive-keyring proxmox-backup-client proxmox-backup-file-restore proxmox-backup-restore-image proxmox-kernel-helper
proxmox-mail-forward proxmox-mini-journalreader proxmox-websocket-tunnel proxmox-widget-toolkit psmisc pve-cluster pve-docs pve-edk2-firmware pve-firewall pve-firmware pve-i18n pve-lxc-syscalld pve-xtermjs python-apt-common
python-pastedeploy-tpl python3 python3-apt python3-bcrypt python3-bs4 python3-certifi python3-cffi-backend python3-chardet python3-cherrypy3 python3-cryptography python3-dateutil python3-dbus python3-debconf python3-debian
python3-debianbts python3-dev python3-distro-info python3-distutils python3-gi python3-httplib2 python3-idna python3-jwt python3-ldb python3-lib2to3 python3-logutils python3-mako python3-markupsafe python3-minimal python3-natsort
python3-openssl python3-paste python3-pastedeploy python3-pecan python3-pip python3-pkg-resources python3-prettytable python3-protobuf python3-pycurl python3-pysimplesoap python3-reportbug python3-requests python3-setuptools
python3-simplegeneric python3-singledispatch python3-six python3-soupsieve python3-talloc python3-tempita python3-urllib3 python3-waitress python3-webob python3-webtest python3-werkzeug python3-wheel python3-yaml readline-common
reportbug rpcbind rrdcached rsync rsyslog runit-helper samba-common samba-libs sed sensible-utils shared-mime-info smartmontools smbclient socat spl sqlite3 ssh ssl-cert strace sudo swtpm swtpm-libs swtpm-tools systemd
systemd-sysv sysvinit-utils tar tasksel tasksel-data tcpdump telnet thin-provisioning-tools time traceroute tzdata ucf udev uidmap unattended-upgrades usbutils util-linux uuid-runtime vim-common vim-tiny vncterm wamerican wget
whiptail xfsprogs xkb-data xsltproc xxd xz-utils zfs-initramfs zfs-zed zfsutils-linux zlib1g zlib1g-dev zstd
676 upgraded, 125 newly installed, 24 to remove and 0 not upgraded.
Need to get 0 B/506 MB of archives.
After this operation, 45.5 MB disk space will be freed.
Do you want to continue? [Y/n] y
W: (pve-apt-hook) !! WARNING !!
W: (pve-apt-hook) You are attempting to remove the meta-package 'proxmox-ve'!
W: (pve-apt-hook)
W: (pve-apt-hook) If you really want to permanently remove 'proxmox-ve' from your system, run the following command
W: (pve-apt-hook) touch '/please-remove-proxmox-ve'
W: (pve-apt-hook) run apt purge proxmox-ve to remove the meta-package
W: (pve-apt-hook) and repeat your apt invocation.
W: (pve-apt-hook)
W: (pve-apt-hook) If you are unsure why 'proxmox-ve' would be removed, please verify
W: (pve-apt-hook) - your APT repository settings
W: (pve-apt-hook) - that you are using 'apt full-upgrade' to upgrade your system
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (1)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook