Upgrade Broke It - WARNING !! You are attempting to remove the meta-package 'proxmox-ve'!

[Bliss]

Im lost as what to do, my proxmox server usually runs fine and i don't have to touch it often.

Today i had to reboot it, i got a message from my host "Hetzner" after rebooting saying the mac addresses were not set the same as in the server.
To cut a long story short they say some things that can cause it etc, one of them was proxmox needed upgrading, or block port 43 for a temp fix.

So i logged into the proxmox master GUI (only have this one node) and i went to the upgrade button.


It looked like it was upgrading ok until the end when i got these errors.

.
Get:106 http://mirror.hetzner.de/debian/security buster/updates/main amd64 linux-image-4.19.0-23-amd64 amd64 4.19.269-1 [48.6 MB]
Get:107 http://mirror.hetzner.de/debian/security buster/updates/main amd64 linux-image-amd64 amd64 4.19+105+deb10u18 [8712 B]
Get:108 http://mirror.hetzner.de/debian/security buster/updates/main amd64 openssl amd64 1.1.1n-0+deb10u4 [855 kB]
Get:109 http://mirror.hetzner.de/debian/packages buster/main amd64 os-prober amd64 1.77 [30.2 kB]
Get:110 http://mirror.hetzner.de/debian/packages buster/main amd64 postfix amd64 3.4.23-0+deb10u1 [1529 kB]
Get:111 http://mirror.hetzner.de/debian/security buster/updates/main amd64 python3-cryptography amd64 2.6.1-3+deb10u4 [218 kB]
Get:112 http://mirror.hetzner.de/debian/security buster/updates/main amd64 xsltproc amd64 1.1.32-2.2~deb10u2 [122 kB]
Fetched 149 MB in 9s (17.5 MB/s)
W: (pve-apt-hook) !! WARNING !!
W: (pve-apt-hook) You are attempting to remove the meta-package 'proxmox-ve'!
W: (pve-apt-hook)
W: (pve-apt-hook) If you really want to permanently remove 'proxmox-ve' from your system, run the following command
W: (pve-apt-hook) touch '/please-remove-proxmox-ve'
W: (pve-apt-hook) run apt purge proxmox-ve to remove the meta-package
W: (pve-apt-hook) and repeat your apt invocation.
W: (pve-apt-hook)
W: (pve-apt-hook) If you are unsure why 'proxmox-ve' would be removed, please verify
W: (pve-apt-hook) - your APT repository settings
W: (pve-apt-hook) - that you are using 'apt full-upgrade' to upgrade your system
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (1)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook

System not fully up to date (found 113 new packages)



It was on

Virtual Environment 6.2

and now it says


Virtual Environment 6.4-14

After this the vm's say they are started and all the Linux VM/CT are running fine, the Windows ones seem to be running (i can access the desktop via VNC) but now they have no network working.

How can this be fixed ? ( i have a full log of the update from start to finish (i copied the shell text) but its large so didnt want to just post it here.

Thanks in advance, any help be much appreciated.

 

[fabian]

please post the full output of

- pveversion -v
- apt update
- apt full-upgrade
-cat /etc/apt/sources.list /etc/apt/sources.list.d/*

each in code tags.

 

[Bliss]

Thank you Fabian, here are the outputs.

root@server1 ~ # pveversion -v
proxmox-ve: 6.4-1 (running kernel: 5.4.174-2-pve)
pve-manager: 6.4-14 (running version: 6.4-14/15e2bf61)
pve-kernel-5.4: 6.4-15
pve-kernel-helper: 6.4-15
pve-kernel-5.4.174-2-pve: 5.4.174-2
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.1.5-pve2~bpo10+1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve4~bpo10
libjs-extjs: 6.0.1-10
libknet1: 1.22-pve2~bpo10+1
libproxmox-acme-perl: 1.1.0
libproxmox-backup-qemu0: 1.1.0-1
libpve-access-control: 6.4-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.4-4
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.2-3
libpve-storage-perl: 6.4-1
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.1.13-2
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.6-2
pve-cluster: 6.4-1
pve-container: 3.3-6
pve-docs: 6.4-2
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-4
pve-firmware: 3.3-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-6
pve-xtermjs: 4.7.0-3
qemu-server: 6.4-2
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2

root@server1 ~ # apt update
Hit:1 http://mirror.hetzner.de/debian/packages buster InRelease
Hit:2 http://mirror.hetzner.de/debian/security buster/updates InRelease                                        
Hit:3 http://mirror.hetzner.de/debian/packages buster-updates InRelease                                        
Get:4 http://mirror.hetzner.com/debian/pve buster InRelease [2,659 B]                                          
Get:5 http://security.debian.org/debian-security buster/updates InRelease [34.8 kB]                            
Hit:6 http://download.proxmox.com/debian/pve buster InRelease                                                  
Hit:7 http://deb.debian.org/debian buster InRelease                                                            
Get:8 http://deb.debian.org/debian buster-updates InRelease [56.6 kB]                    
Fetched 94.1 kB in 1s (157 kB/s)                                                                      
Reading package lists... Done
Building dependency tree    
Reading state information... Done
108 packages can be upgraded. Run 'apt list --upgradable' to see them.

root@server1 ~ # apt full-upgrade
Reading package lists... Done
Building dependency tree    
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  ceph-common ceph-fuse cifs-utils corosync criu cstream dtach ebtables faketime fontconfig fontconfig-config
  fonts-dejavu-core fonts-font-awesome fonts-glyphicons-halflings genisoimage glusterfs-client glusterfs-common
  hdparm ipset iso-codes libacl1-dev libanyevent-http-perl libanyevent-perl libappconfig-perl libapt-pkg-perl
  libarchive13 libasound2 libasound2-data libasyncns0 libattr1-dev libauthen-pam-perl libavahi-client3
  libavahi-common-data libavahi-common3 libbabeltrace1 libboost-atomic1.67.0 libboost-program-options1.67.0
  libboost-regex1.67.0 libboost-thread1.67.0 libc-dev-bin libc6-dev libcaca0 libcairo2 libcephfs2 libcfg7
  libclone-perl libcmap4 libcorosync-common4 libcpg4 libcrypt-openssl-bignum-perl libcrypt-openssl-random-perl
  libcrypt-openssl-rsa-perl libcups2 libcurl3-gnutls libdatrie1 libdbi1 libdevel-cycle-perl libdw1 libfaketime
  libfile-chdir-perl libfile-readbackwards-perl libfilesys-df-perl libflac8 libfontconfig1 libfuse3-3 libgfapi0
  libgfchangelog0 libgfdb0 libgfrpc0 libgfxdr0 libglusterfs-dev libglusterfs0 libgnutlsxx28 libgoogle-perftools4
  libgraphite2-3 libgstreamer-plugins-base1.0-0 libgstreamer1.0-0 libharfbuzz0b libibverbs1 libice6
  libio-multiplex-perl libio-stringy-perl libipset11 libiscsi7 libjansson4 libjemalloc2 libjpeg62-turbo
  libjs-bootstrap libjs-extjs libjs-jquery libjs-sphinxdoc libjs-underscore libknet1 libldb1
  liblinux-inotify2-perl libmime-base32-perl libnet-dbus-perl libnet-dns-perl libnet-ip-perl libnet1
  libnetfilter-log1 libnl-3-200 libnl-route-3-200 libnspr4 libnss3 libogg0 libopus0 liborc-0.4-0 libpango-1.0-0
  libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libprotobuf17 libproxmox-acme-perl libproxmox-acme-plugins
  libproxmox-backup-qemu0 libpulse0 libpve-access-control libpve-apiclient-perl libpve-cluster-api-perl
  libpve-cluster-perl libpve-common-perl libpve-guest-common-perl libpve-http-server-perl libpve-storage-perl
  libpve-u2f-server-perl libpython2.7 libpython3.7 libqb0 libqrencode4 libquorum5 librados2 librados2-perl
  libradosstriper1 librbd1 librdmacm1 librrd8 librrds-perl libsdl1.2debian libsm6 libsmbclient libsnappy1v5
  libsndfile1 libspice-server1 libstatgrab10 libstring-shellquote-perl libtalloc2 libtcmalloc-minimal4 libtdb1
  libtemplate-perl libtevent0 libthai-data libthai0 libu2f-server0 libunwind8 liburcu6 libusbredirparser1
  libuuid-perl libvorbis0a libvorbisenc2 libvotequorum8 libwbclient0 libx11-6 libx11-data libx11-xcb1 libxau6
  libxcb-render0 libxcb-shm0 libxcb1 libxdmcp6 libxext6 libxi6 libxml-libxml-perl libxml-twig-perl libxrender1
  libxslt1.1 libxtst6 libyaml-0-2 libyaml-libyaml-perl linux-image-4.19.0-18-amd64 linux-libc-dev lxc-pve lxcfs
  lzop novnc-pve numactl proxmox-archive-keyring proxmox-backup-client proxmox-backup-file-restore
  proxmox-mini-journalreader pve-cluster pve-container pve-docs pve-edk2-firmware pve-firewall pve-ha-manager
  pve-i18n pve-kernel-helper pve-lxc-syscalld pve-manager pve-qemu-kvm pve-xtermjs python-cephfs python-certifi
  python-chardet python-configparser python-future python-idna python-ipaddr python-pkg-resources
  python-prettytable python-protobuf python-rados python-rbd python-requests python-six python-talloc
  python-urllib3 python3-jwt python3-prettytable qemu-server qrencode rrdcached samba-common samba-libs
  smartmontools smbclient socat spiceterm sqlite3 uidmap vncterm x11-common xsltproc zstd
Use 'apt autoremove' to remove them.
The following packages will be REMOVED:
  proxmox-ve pve-firmware pve-kernel-5.4
The following NEW packages will be installed:
  firmware-linux-free linux-image-4.19.0-23-amd64 os-prober
The following packages will be upgraded:
  base-files bind9-host cifs-utils curl dbus dirmngr dpkg gnupg gnupg-l10n gnupg-utils gpg gpg-agent
  gpg-wks-client gpg-wks-server gpgconf gpgsm gpgv grub-common grub-efi-amd64-bin grub-pc grub-pc-bin
  grub2-common gzip intel-microcode isc-dhcp-client isc-dhcp-common krb5-locales libarchive13 libbind9-161
  libbz2-1.0 libc-bin libc-dev-bin libc-l10n libc6 libc6-dev libcups2 libcurl3-gnutls libcurl4 libdbus-1-3
  libdns-export1104 libdns1104 libexpat1 libflac8 libfreetype6 libfribidi0 libglib2.0-0 libgssapi-krb5-2
  libhttp-daemon-perl libisc-export1100 libisc1100 libisccc161 libisccfg163 libk5crypto3 libkrb5-3
  libkrb5support0 libksba8 libldap-2.4-2 libldap-common liblwres161 liblzma5 libncurses6 libncursesw6
  libnet-ssleay-perl libnss3 libpcre2-8-0 libpixman-1-0 libpve-common-perl libpve-http-server-perl libpython3.7
  libpython3.7-minimal libpython3.7-stdlib libsndfile1 libsqlite3-0 libssl1.1 libtasn1-6 libtinfo6
  libtirpc-common libtirpc3 libxml2 libxslt1.1 linux-image-amd64 linux-libc-dev locales ncurses-base ncurses-bin
  ncurses-term openssl postfix proxmox-backup-client proxmox-backup-file-restore pve-kernel-helper pve-manager
  pve-qemu-kvm python3-cryptography python3.7 python3.7-minimal rsyslog sqlite3 tzdata vim vim-common vim-runtime
  vim-tiny xsltproc xxd xz-utils zlib1g
107 upgraded, 3 newly installed, 3 to remove and 0 not upgraded.
Need to get 0 B/148 MB of archives.
After this operation, 116 MB disk space will be freed.
Do you want to continue? [Y/n] y
W: (pve-apt-hook) !! WARNING !!
W: (pve-apt-hook) You are attempting to remove the meta-package 'proxmox-ve'!
W: (pve-apt-hook)
W: (pve-apt-hook) If you really want to permanently remove 'proxmox-ve' from your system, run the following command
W: (pve-apt-hook)       touch '/please-remove-proxmox-ve'
W: (pve-apt-hook) run apt purge proxmox-ve to remove the meta-package
W: (pve-apt-hook) and repeat your apt invocation.
W: (pve-apt-hook)
W: (pve-apt-hook) If you are unsure why 'proxmox-ve' would be removed, please verify
W: (pve-apt-hook)       - your APT repository settings
W: (pve-apt-hook)       - that you are using 'apt full-upgrade' to upgrade your system
E: Sub-process /usr/share/proxmox-ve/pve-apt-hook returned an error code (1)
E: Failure running script /usr/share/proxmox-ve/pve-apt-hook
root@server1 ~ #

root@server1 ~ # cat /etc/apt/sources.list /etc/apt/sources.list.d/*
deb http://mirror.hetzner.de/debian/packages buster main contrib non-free
deb http://mirror.hetzner.de/debian/security buster/updates main contrib non-free
deb http://mirror.hetzner.de/debian/packages buster-updates main contrib non-free

#

# deb cdrom:[Debian GNU/Linux 10.0.0 _Buster_ - Official amd64 NETINST 20190706-10:23]/ buster main

#deb cdrom:[Debian GNU/Linux 10.0.0 _Buster_ - Official amd64 NETINST 20190706-10:23]/ buster main

deb http://deb.debian.org/debian/ buster main non-free contrib
# deb-src http://deb.debian.org/debian/ buster main non-free contrib

deb http://security.debian.org/debian-security buster/updates main contrib non-free
# deb-src http://security.debian.org/debian-security buster/updates main contrib non-free

# buster-updates, previously known as 'volatile'
deb http://deb.debian.org/debian/ buster-updates main contrib non-free
# deb-src http://deb.debian.org/debian/ buster-updates main contrib non-free

# This system was installed using small removable media
# (e.g. netinst, live or single CD). The matching "deb cdrom"
# entries were disabled at the end of the installation process.
# For information about how to configure apt package sources,
# see the sources.list(5) manual.


# PVE packages provided by proxmox.com
deb http://mirror.hetzner.com/debian/pve buster pve-no-subscription

deb http://download.proxmox.com/debian/pve buster pve-no-subscription

root@server1 ~ #

 

[fabian]

please remove the stock Debian kernel (linux-image-amd64 and friends), then retry the upgrade.

 

[Bliss]

please remove the stock Debian kernel (linux-image-amd64 and friends), then retry the upgrade.

how would i do that? Im not used to debian?

These are what is installed, i dont want to break the system more, i know centos but not debian

root@server1 ~ # uname -sr
Linux 5.4.174-2-pve
root@server1 ~ # dpkg -l | grep linux-image | awk '{print$2}'
linux-image-4.19.0-18-amd64
linux-image-4.19.0-19-amd64
linux-image-4.19.0-20-amd64
linux-image-amd64
root@server1 ~ #

I havent tried to reboot either since the broken upgrade, not sure if that helps.

After a bit of googling i found this.

$ sudo apt remove --purge linux-image-4.4.0-21-generic
$ sudo update-grub2
$ sudo reboot

so am i right thinking i do the above for the following kernels ? :-

linux-image-4.19.0-18-amd64
linux-image-4.19.0-19-amd64
linux-image-4.19.0-20-amd64

? what about linux-image-amd64 do i do it for that one also ?

It seems the Windows VM's now have network, not sure why but at least all vm's are live again,.

Grateful if anyone can tell me if i am on the right track to remove these kernels.


Thanks in advance

 

[fabian]

yes, all four packages starting with linux-image should be removed in your case.

 

[Bliss]

yes, all four packages starting with linux-image should be removed in your case.

Thank You.

I will do that as soon as i have slept have a great day Fabian