unable to upgrade from 7.4-16 to version 8

izzy477

New Member
Apr 14, 2022
19
0
1
47
NYC
I have a three node cluster running on dell micro 3040's. they have 32 gb of ram and 2 x 1tb ssd(1 nvme and 1 sata)

I have three of the ssd in a ceph cluster which I use to run my vm's and ct's

I was following the upgrade instructions. I added the new repos, ran the upgrade.

When i initially ran the upgrade I received an error which I did not get a screenshot of. It contained a command to run before running the upgrade. I think i removed the pve from my system.

It still shows up on the cluster when I log into the other nodes but everything is greyed out. The only thing I can access is the shell. I am still able to run commands in the shell so i am hoping there is a command to re-install the pve but after googling and searching the forums I am unable to find it.

It still has the cluster info as when I run the "pvecm status" command i get the following:

Cluster information
-------------------
Name: CLSTRFK
Config Version: 3
Transport: knet
Secure auth: on

Quorum information
------------------
Date: Sun Sep 17 23:49:09 2023
Quorum provider: corosync_votequorum
Nodes: 3
Node ID: 0x00000001
Ring ID: 1.41fa
Quorate: Yes

Votequorum information
----------------------
Expected votes: 3
Highest expected: 3
Total votes: 3
Quorum: 2
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000001 1 192.168.0.250 (local)
0x00000002 1 192.168.0.251
0x00000003 1 192.168.0.252
root@PROX1:~#

luckily I moved all of my machines off to another node before the upgrade attempt. if anyone can help it would be greatly appreciated.
 
Hi,

First we have to know what package is removed, to know that you can share the `/var/log/apt/history.log` file.

Can you do the pveversion -v command? if no you can try `apt install pve-manager proxmox-ve`
 
Hi,

First we have to know what package is removed, to know that you can share the `/var/log/apt/history.log` file.

Can you do the pveversion -v command? if no you can try `apt install pve-manager proxmox-ve`
got the following when i tried those commands. also tried updating python buit it says its up to date

The following packages have unmet dependencies:
python3-cephfs : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rados : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rbd : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rgw : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
E: Unable to correct problems, you have held broken packages.
root@PROX1:~# ^C
root@PROX1:~# ^C
root@PROX1:~# pveversion -v
-bash: pveversion: command not found
 
history.log file is empty but i have a ton of others i can upload if you think it would help

root@PROX1:/var/log/apt# ls
eipp.log.xz history.log.2.gz history.log.5.gz history.log.8.gz term.log.1.gz term.log.4.gz term.log.7.gz
history.log history.log.3.gz history.log.6.gz history.log.9.gz term.log.2.gz term.log.5.gz term.log.8.gz
history.log.1.gz history.log.4.gz history.log.7.gz term.log term.log.3.gz term.log.6.gz term.log.9.gz
root@PROX1:/var/log/apt#
 
Could you please share the contents of `/etc/apt/sources.list` and of each file in `/etc/apt/sources.list.d`?
 
here are the logs.
 

Attachments

  • history.log.1.gz
    9.4 KB · Views: 1
  • history.log.2.gz
    255 bytes · Views: 0
  • history.log.3.gz
    738 bytes · Views: 0
  • history.log.4.gz
    703 bytes · Views: 0
  • history.log.5.gz
    245 bytes · Views: 0
  • history.log.6.gz
    813 bytes · Views: 0
  • history.log.7.gz
    670 bytes · Views: 0
  • history.log.8.gz
    1.1 KB · Views: 0
  • history.log.9.gz
    2 KB · Views: 0
Could you please share the contents of `/etc/apt/sources.list` and of each file in `/etc/apt/sources.list.d`?
sources.list


deb http://ftp.debian.org/debian bookworm main contrib
deb http://ftp.debian.org/debian bookworm-updates main contrib

# Proxmox VE pve-no-subscription repository provided by proxmox.com,
# NOT recommended for production use
deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription

# security updates
deb http://security.debian.org/debian-security bookworm-security main contrib



sources.list.d

root@PROX1:/etc/apt/sources.list.d# dir
ceph.list pve-community.list pve-enterprise.list pve-install-repo.list
root@PROX1:/etc/apt/sources.list.d#

Ceph.list
deb http://download.proxmox.com/debian/ceph-quincy bullseye main

pve-community.list
deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription

pve-enterprise.list
deb https://enterprise.proxmox.com/debian/pve bookworm pve-enterprise

pve-install-repo.list
deb http://download.proxmox.com/debian jessie pve-no-subscription
~
 
Hi,

First we have to know what package is removed, to know that you can share the `/var/log/apt/history.log` file.

Can you do the pveversion -v command? if no you can try `apt install pve-manager proxmox-ve`
root@PROX1:/# pveversion -v
-bash: pveversion: command not found
root@PROX1:/#

root@PROX1:/# apt install pve-manager proxmox-ve
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
python3-cephfs : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rados : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rbd : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
python3-rgw : Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
E: Unable to correct problems, you have held broken packages.
root@PROX1:/#
 
root@PROX1:/# apt install python3
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
python3 is already the newest version (3.11.2-1+b1).
The following packages were automatically installed and are no longer required:
ceph-mgr-modules-core libjs-sencha-touch libslirp0 libsqlite3-mod-ceph proxmox-kernel-helper
proxmox-mail-forward proxmox-offline-mirror-docs proxmox-offline-mirror-helper pve-kernel-5.15.102-1-pve
pve-kernel-5.15.104-1-pve pve-kernel-5.15.107-1-pve pve-kernel-5.15.107-2-pve pve-kernel-5.15.83-1-pve
pve-kernel-5.15.85-1-pve python-pastedeploy-tpl python3-autocommand python3-bcrypt python3-bs4 python3-cheroot
python3-cherrypy3 python3-dateutil python3-inflect python3-jaraco.classes python3-jaraco.collections
python3-jaraco.context python3-jaraco.functools python3-jaraco.text python3-logutils python3-more-itertools
python3-natsort python3-paste python3-pastedeploy python3-pastedeploy-tpl python3-pecan python3-portend
python3-simplegeneric python3-singledispatch python3-soupsieve python3-tempita python3-tempora python3-tz
python3-waitress python3-webob python3-webtest python3-werkzeug python3-zc.lockfile sudo telnet
Use 'apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
root@PROX1:/#
 
Have you read the Upgrade Guide? Have you upgraded ceph to version 17 Quincy ON ALL NODES before Proxmox Upgrade?

If not, do so ;)

https://pve.proxmox.com/wiki/Upgrade_from_7_to_8

Adjust your sources:

root@PROX1:/etc/apt/sources.list.d#

Ceph.list
#deb http://download.proxmox.com/debian/ceph-quincy bullseye main
deb http://download.proxmox.com/debian/ceph-quincy bookworm main

pve-community.list
# Already in sources list deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription

pve-enterprise.list
# You use the community repo deb https://enterprise.proxmox.com/debian/pve bookworm pve-enterprise

pve-install-repo.list
# VERY old ;) deb http://download.proxmox.com/debian jessie pve-no-subscription

apt update

apt full-upgrade -d

apt -f install

apt install proxmox-ve

apt full-upgrade
 
Replace:
with:
Bash:
deb http://download.proxmox.com/debian/ceph-quincy bookworm no-subscription

Remove/Delete:
pve-community.list
deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription
since you have it already in: /etc/apt/sources.list

Comment out (add: # in front of the line):
pve-enterprise.list
deb https://enterprise.proxmox.com/debian/pve bookworm pve-enterprise
if you do not have an active subscription.

Remove/Delete:
pve-install-repo.list
deb http://download.proxmox.com/debian jessie pve-no-subscription
since it is ages old.

Afterwards run: apt update followed by:
apt install pve-manager proxmox-ve

If all went through successfully without any errors, I would lastly also run an: apt full-upgrade

But, of course, you might want to wait for an answer from the Proxmox staff.


Edit: I was too slow. :eek:
 
Last edited:
Have you read the Upgrade Guide? Have you upgraded ceph to version 17 Quincy ON ALL NODES before Proxmox Upgrade?

If not, do so ;)

https://pve.proxmox.com/wiki/Upgrade_from_7_to_8

Adjust your sources:

root@PROX1:/etc/apt/sources.list.d#

Ceph.list
#deb http://download.proxmox.com/debian/ceph-quincy bullseye main
deb http://download.proxmox.com/debian/ceph-quincy bookworm main

pve-community.list
# Already in sources list deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription

pve-enterprise.list
# You use the community repo deb https://enterprise.proxmox.com/debian/pve bookworm pve-enterprise

pve-install-repo.list
# VERY old ;) deb http://download.proxmox.com/debian jessie pve-no-subscription

apt update

apt full-upgrade -d

apt -f install

apt install proxmox-ve

apt full-upgrade
I verified on the 2 working proxmox nodes that i have successfully upgraded ceph to 17.

I made the changes you recommended to the repos and got the following errors when running the commands recommended

root@PROX1:~# apt update
Hit:1 http://ftp.debian.org/debian bookworm InRelease
Get:2 http://ftp.debian.org/debian bookworm-updates InRelease [52.1 kB]
Get:3 http://security.debian.org/debian-security bookworm-security InRelease [48.0 kB]
Hit:4 http://download.proxmox.com/debian/pve bookworm InRelease
Hit:5 http://download.proxmox.com/debian/ceph-quincy bookworm InRelease
Err:6 https://enterprise.proxmox.com/debian/pve bookworm InRelease
401 Unauthorized [IP: 144.217.225.162 443]
Reading package lists... Done
E: Failed to fetch https://enterprise.proxmox.com/debian/pve/dists/bookworm/InRelease 401 Unauthorized [IP: 144.217.225.162 443]
E: The repository 'https://enterprise.proxmox.com/debian/pve bookworm InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
root@PROX1:~#
root@PROX1:~# apt full-upgrade -d

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
ceph-mgr-modules-core libfmt7 libjs-sencha-touch libslirp0 libsqlite3-mod-ceph libthrift-0.13.0
proxmox-kernel-6.2.16-12-pve proxmox-kernel-helper proxmox-mail-forward proxmox-offline-mirror-docs
proxmox-offline-mirror-helper pve-kernel-5.15.102-1-pve pve-kernel-5.15.104-1-pve pve-kernel-5.15.107-1-pve
pve-kernel-5.15.107-2-pve pve-kernel-5.15.83-1-pve pve-kernel-5.15.85-1-pve python-pastedeploy-tpl
python3-autocommand python3-bcrypt python3-bs4 python3-cheroot python3-cherrypy3 python3-dateutil
python3-inflect python3-jaraco.classes python3-jaraco.collections python3-jaraco.context
python3-jaraco.functools python3-jaraco.text python3-logutils python3-more-itertools python3-natsort
python3-paste python3-pastedeploy python3-pastedeploy-tpl python3-pecan python3-portend python3-simplegeneric
python3-singledispatch python3-soupsieve python3-tempita python3-tempora python3-tz python3-waitress
python3-webob python3-webtest python3-werkzeug python3-zc.lockfile sudo telnet
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
libfmt9 liblttng-ust-common1 liblttng-ust-ctl5 liblttng-ust1 libthrift-0.17.0 proxmox-kernel-6.2.16-15-pve
The following packages will be upgraded:
bind9-dnsutils bind9-host bind9-libs ceph-fuse ceph-mgr-modules-core grub-common grub-efi-amd64-bin grub-pc
grub-pc-bin grub2-common ifupdown2 libc-bin libc-l10n libc6 libcephfs2 libknet1 libnozzle1 libnvpair3linux
libpve-cluster-api-perl libpve-cluster-perl libpve-common-perl librados2 libradosstriper1 librbd1 librgw2
libsqlite3-mod-ceph libuutil3linux libx11-6 libx11-data libx11-xcb1 libzfs4linux libzpool5linux locales
proxmox-backup-client proxmox-backup-file-restore proxmox-kernel-6.2 proxmox-widget-toolkit pve-cluster pve-docs
pve-i18n python3-ceph-argparse python3-ceph-common spl zfs-initramfs zfs-zed zfsutils-linux
46 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/158 MB of archives.
After this operation, 569 MB of additional disk space will be used.
Do you want to continue? [Y/n] Y
Download complete and in download only mode
root@PROX1:~# apt -f install

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
ceph-mgr-modules-core libjs-sencha-touch libslirp0 libsqlite3-mod-ceph proxmox-kernel-helper
proxmox-mail-forward proxmox-offline-mirror-docs proxmox-offline-mirror-helper pve-kernel-5.15.102-1-pve
pve-kernel-5.15.104-1-pve pve-kernel-5.15.107-1-pve pve-kernel-5.15.107-2-pve pve-kernel-5.15.83-1-pve
pve-kernel-5.15.85-1-pve python-pastedeploy-tpl python3-autocommand python3-bcrypt python3-bs4 python3-cheroot
python3-cherrypy3 python3-dateutil python3-inflect python3-jaraco.classes python3-jaraco.collections
python3-jaraco.context python3-jaraco.functools python3-jaraco.text python3-logutils python3-more-itertools
python3-natsort python3-paste python3-pastedeploy python3-pastedeploy-tpl python3-pecan python3-portend
python3-simplegeneric python3-singledispatch python3-soupsieve python3-tempita python3-tempora python3-tz
python3-waitress python3-webob python3-webtest python3-werkzeug python3-zc.lockfile sudo telnet
Use 'apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 46 not upgraded.
root@PROX1:~# apt install proxmox-ve

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
ceph-mgr-modules-core libfmt7 libsqlite3-mod-ceph libthrift-0.13.0 pve-kernel-5.15.102-1-pve
pve-kernel-5.15.104-1-pve pve-kernel-5.15.107-1-pve pve-kernel-5.15.107-2-pve pve-kernel-5.15.83-1-pve
pve-kernel-5.15.85-1-pve python-pastedeploy-tpl python3-autocommand python3-bcrypt python3-bs4 python3-cheroot
python3-cherrypy3 python3-dateutil python3-inflect python3-jaraco.classes python3-jaraco.collections
python3-jaraco.context python3-jaraco.functools python3-jaraco.text python3-logutils python3-more-itertools
python3-natsort python3-paste python3-pastedeploy python3-pastedeploy-tpl python3-pecan python3-portend
python3-simplegeneric python3-singledispatch python3-soupsieve python3-tempita python3-tempora python3-tz
python3-waitress python3-webob python3-webtest python3-werkzeug python3-zc.lockfile sudo telnet
Use 'apt autoremove' to remove them.
The following additional packages will be installed:
ceph-common ceph-fuse ceph-mgr-modules-core libcephfs2 libfmt9 liblttng-ust-common1 liblttng-ust-ctl5
liblttng-ust1 libpve-guest-common-perl libpve-storage-perl librados2 libradosstriper1 librbd1 librgw2
libsqlite3-mod-ceph libthrift-0.17.0 liburing2 numactl proxmox-default-kernel pve-container pve-ha-manager
pve-manager pve-qemu-kvm python3-ceph-argparse python3-ceph-common python3-cephfs python3-rados python3-rbd
python3-rgw qemu-server spiceterm
Suggested packages:
ceph-base ceph-mds libpve-network-perl libgl1
The following NEW packages will be installed:
ceph-common libfmt9 liblttng-ust-common1 liblttng-ust-ctl5 liblttng-ust1 libpve-guest-common-perl
libpve-storage-perl libthrift-0.17.0 liburing2 numactl proxmox-default-kernel proxmox-ve pve-container
pve-ha-manager pve-manager pve-qemu-kvm python3-cephfs python3-rados python3-rbd python3-rgw qemu-server
spiceterm
The following packages will be upgraded:
ceph-fuse ceph-mgr-modules-core libcephfs2 librados2 libradosstriper1 librbd1 librgw2 libsqlite3-mod-ceph
python3-ceph-argparse python3-ceph-common
10 upgraded, 22 newly installed, 0 to remove and 36 not upgraded.
Need to get 56.7 MB/72.2 MB of archives.
After this operation, 424 MB of additional disk space will be used.
Do you want to continue? [Y/n] Y
Get:1 http://ftp.debian.org/debian bookworm/main amd64 liburing2 amd64 2.3-3 [12.6 kB]
Get:2 http://ftp.debian.org/debian bookworm/main amd64 numactl amd64 2.0.16-1 [36.9 kB]
Get:3 http://download.proxmox.com/debian/ceph-quincy bookworm/no-subscription amd64 python3-rados amd64 17.2.6-pve1+3 [293 kB]
Get:4 http://download.proxmox.com/debian/ceph-quincy bookworm/no-subscription amd64 python3-cephfs amd64 17.2.6-pve1+3 [145 kB]
Get:5 http://download.proxmox.com/debian/ceph-quincy bookworm/no-subscription amd64 python3-rbd amd64 17.2.6-pve1+3 [278 kB]
Get:6 http://download.proxmox.com/debian/ceph-quincy bookworm/no-subscription amd64 python3-rgw amd64 17.2.6-pve1+3 [91.8 kB]
Get:7 http://download.proxmox.com/debian/ceph-quincy bookworm/no-subscription amd64 ceph-common amd64 17.2.6-pve1+3 [26.5 MB]
Get:8 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-storage-perl all 8.0.2 [127 kB]
Get:9 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-guest-common-perl all 5.0.5 [34.8 kB]
Get:10 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-default-kernel all 1.0.0 [1,740 B]
Get:11 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-qemu-kvm amd64 8.0.2-6 [28.2 MB]
Get:12 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 qemu-server amd64 8.0.7 [266 kB]
Get:13 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-ha-manager amd64 4.0.2 [63.2 kB]
Get:14 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-container all 5.0.4 [133 kB]
Get:15 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 spiceterm amd64 3.3.0 [53.6 kB]
Get:16 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-manager amd64 8.0.4 [502 kB]
Get:17 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-ve all 8.0.2 [5,024 B]
Fetched 56.7 MB in 2s (28.4 MB/s)
/bin/sh: 1: /usr/share/proxmox-ve/pve-apt-hook: not found
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (127)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!