Errors after apt-get upgrade

[puppet87112]

I hope I am in the right spot, if not I apologize. I get an apt-get update and upgrade and now the VM's that have been created seem like they are running, but I am not longer able to get into proxmox itself just says

This page isn’t working​

192.168.1.20 didn’t send any data.


ERR_EMPTY_RESPONSE

I have verified the service is running, let me know whatever you guys/ladies need to help me out and I will post it. Any help would be appreciated.

 

[sw-omit]

What is the result of
systemctl status pveproxy
And have you already tried restarting the above service? (This is the service that runs the webpage, so if it errors out, that would cause the webpage to not work either.


Also: Apt-get update and upgrade is NOT the method/commands to update Proxmox.
You should use "apt dist-upgrade" to upgrade Proxmox, or risk breaking things, or just use the GUI to trigger the upgrade, and read what it is going to do before just pressing Y/enter.

Note 2: Just to confirm, is this PVE or PBS with the issue? Because you are currently posting in the Proxmox Backup Server section, but you are talking about VM's running which sounds like Proxmox Virtual Environment

 

[puppet87112]

What is the result of
systemctl status pveproxy
And have you already tried restarting the above service? (This is the service that runs the webpage, so if it errors out, that would cause the webpage to not work either.


Also: Apt-get update and upgrade is NOT the method/commands to update Proxmox.
You should use "apt dist-upgrade" to upgrade Proxmox, or risk breaking things, or just use the GUI to trigger the upgrade, and read what it is going to do before just pressing Y/enter.

Note 2: Just to confirm, is this PVE or PBS with the issue? Because you are currently posting in the Proxmox Backup Server section, but you are talking about VM's running which sounds like Proxmox Virtual Environment

This is the virtual environment I apologize for choosing the wrong section.

to upgrade I putty into the server and did an apt-get update then upgrade and that's when it broke. That was my fault for not reading how to properly update.
This is what is says when you do the systemctl status pveproxy and I tried restarting that service with no success.

Jul 21 06:25:05 r710pve01 pveproxy[3045]: starting 3 worker(s)
Jul 21 06:25:05 r710pve01 pveproxy[3045]: worker 15833 started
Jul 21 06:25:05 r710pve01 pveproxy[3045]: worker 15834 started
Jul 21 06:25:05 r710pve01 pveproxy[3045]: worker 15835 started
Jul 21 06:25:10 r710pve01 pveproxy[3048]: worker exit
Jul 21 06:25:10 r710pve01 pveproxy[3049]: worker exit
Jul 21 06:25:10 r710pve01 pveproxy[3050]: worker exit
Jul 21 06:25:10 r710pve01 pveproxy[3045]: worker 3050 finished
Jul 21 06:25:10 r710pve01 pveproxy[3045]: worker 3049 finished
Jul 21 06:25:11 r710pve01 pveproxy[3045]: worker 3048 finished

 

[puppet87112]

What is the result of
systemctl status pveproxy
And have you already tried restarting the above service? (This is the service that runs the webpage, so if it errors out, that would cause the webpage to not work either.


Also: Apt-get update and upgrade is NOT the method/commands to update Proxmox.
You should use "apt dist-upgrade" to upgrade Proxmox, or risk breaking things, or just use the GUI to trigger the upgrade, and read what it is going to do before just pressing Y/enter.

Note 2: Just to confirm, is this PVE or PBS with the issue? Because you are currently posting in the Proxmox Backup Server section, but you are talking about VM's running which sounds like Proxmox Virtual Environment

Sorry copied the wrong thing I believe.
● pveproxy.service - PVE API Proxy Server
Loaded: loaded (/lib/systemd/system/pveproxy.service; enabled; vendor preset: enabled)
Active: active (running) since Sat 2024-07-20 21:33:08 MDT; 14h ago
Process: 3021 ExecStop=/usr/bin/pveproxy stop (code=exited, status=0/SUCCESS)
Process: 15782 ExecReload=/usr/bin/pveproxy restart (code=exited, status=0/SUCCESS)
Process: 3025 ExecStart=/usr/bin/pveproxy start (code=exited, status=0/SUCCESS)
Main PID: 3045 (pveproxy)
Tasks: 4 (limit: 4915)
Memory: 108.3M
CPU: 7.070s
CGroup: /system.slice/pveproxy.service
├─ 3045 pveproxy
├─15833 pveproxy worker
├─15834 pveproxy worker
└─15835 pveproxy worker

 

[Azunai333]

Never do a apt upgrade, use apt dist-upgrade or apt full-upgrade instead.

That said, what is the output of apt update?

 

[puppet87112]

I got allot of this

e: the repository 'http://ftp.us.debian.org/debian stretch release' does no longer have a release file.

And this

e: the repository 'http://security.debian.org stretch/updates release' does no longer have a release file.

And then it broke.

 

[Azunai333]

There might be a problem with the repositories.
Please give us the *full* output of apt update.

Edit: And the output of pveversion -v, too, please.

 

[JensF]

Debian Stretch is version 9 from 2017! Current version is Debian Bookwork version 12!
How old is your installation??

 

[puppet87112]

There might be a problem with the repositories.
Please give us the *full* output of apt update.

Edit: And the output of pveversion -v, too, please.

Here is the output apt update

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Sat Jul 20 21:31:12 2024 from 192.168.1.190
root@r710pve01:~# apt update
Err:1 http://download.proxmox.com/debian/pve stretch InRelease
Temporary failure resolving 'download.proxmox.com'
Err:2 http://hwraid.le-vert.net/debian jessie InRelease
Temporary failure resolving 'hwraid.le-vert.net'
Err:3 http://archive.debian.org/debian-security stretch/updates InRelease
Temporary failure resolving 'archive.debian.org'
Reading package lists... Done
Building dependency tree
Reading state information... Done
11 packages can be upgraded. Run 'apt list --upgradable' to see them.
W: Failed to fetch http://download.proxmox.com/debian/pve/dists/stretch/InRelease Temporary failure resolving 'download.proxmox.com'
W: Failed to fetch http://hwraid.le-vert.net/debian/dists/jessie/InRelease Temporary failure resolving 'hwraid.le-vert.net'
W: Failed to fetch http://archive.debian.org/debian-security/dists/stretch/updates/InRelease Temporary failure resolving 'archive.debian.org'
W: Some index files failed to download. They have been ignored, or old ones used instead.

pveversion -v output
proxmox-ve: 5.4-2 (running kernel: 4.15.18-30-pve)
pve-manager: 5.1-43 (running version: 5.1-43/bdb08029)
pve-kernel-4.13.4-1-pve: 4.13.4-26
pve-kernel-4.15.18-30-pve: 4.15.18-58
pve-kernel-4.15: 5.4-19
pve-kernel-4.13.13-5-pve: 4.13.13-38
libpve-http-server-perl: 2.0-14
lvm2: 2.02.168-pve6
corosync: 2.4.4-pve1
libqb0: 1.0.3-1~bpo9
pve-cluster: 5.0-19
qemu-server: 5.0-20
pve-firmware: 2.0-7
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.4-2
pve-qemu-kvm: 2.9.1-6
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-9
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1+deb9u1
lxc-pve: 3.1.0-7
lxcfs: 3.0.3-pve1
criu: 2.11.1-1~bpo90
novnc-pve: 1.0.0-3
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.13-pve1~bpo2
libpve-apiclient-perl: 2.0-5

Debian Stretch is version 9 from 2017! Current version is Debian Bookwork version 12!
How old is your installation??

Its years old like 5-6 years old, and I haven't tried to update it until now.

 

[Azunai333]

Temporary failure resolving 'download.proxmox.com'

The DNS resolving (or the complete internet access) is not working. This is the first thing that needs fixing.

11 packages can be upgraded. Run 'apt list --upgradable' to see them.

OK, not all packages were upgraded. Probably it did a half upgrade and this caused the problems.

Err:1 http://download.proxmox.com/debian/pve stretch InRelease
Err:2 http://hwraid.le-vert.net/debian jessie InRelease
Err:3 http://archive.debian.org/debian-security stretch/updates InRelease

There are repositories for different Debian versions configured.
"Jessie" is Debian 8, which is PVE 4.x. This is an older version.
"Stretch" is Debian 9, which is PVE 5.x. This is the right version, you are using PVE 5.x.

- Is the hwraid repository a driver for your hardware raid? Maybe you should change it to "stretch". But I'm not sure about this one.
- You are missing the main Debian repo for stretch. This line needs to be added to your /etc/apt/sources.list.
http://archive.debian.org/debian stretch main contrib

 

[puppet87112]

Thank you everyone, doing that last one made it start working again, what is the best way to upgrade and do security patches in the future so I don't cause this issue anymore?

 

[sw-omit]

First of all, use apt dist-upgrade or apt full-upgrade instead of apt upgrade, or use the GUI under the root account to start the updates.
Secondly, read the message saying "I'm going to install A, update B, remove C, is this OK?" and especially take note of anything it wants to remove before pressing Y.

If you are in a cluster of servers, update one first, restart if necessary (or maybe just do anyway so you can see any issues on-boot triggered right away instead of 3 months and 7 updates down the road). If you're not in a cluster, make sure you have proper (tested) backups of any VM's you care about (so that if you have to re-install it isn't that bad), although even just in general that's good practise.
And also just keep an eye on these forums once updates get released.

Alternatively, if you have a second disk / disk-slot, you could also clone your disk before (big) updates for easy swap-in or copy-over replacement, although 9/10 times all non-hardware, update-related issues can be fixed via commands, more a matter of how long you're willing to spend on it.

Those would be my tips at least

 

[Neobin]

Thank you everyone, doing that last one made it start working again, what is the best way to upgrade and do security patches in the future so I don't cause this issue anymore?

One after the other:

1. https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0
2. https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0
3. https://pve.proxmox.com/wiki/Upgrade_from_7_to_8

Edit: Triple check, that you are using the proper repositories (Debian and PVE) for each version! The sed command in the older upgrade guide(s) might not be sufficient any more (at your current state)...

In general:

• https://pve.proxmox.com/wiki/System_Software_Updates
• https://pve.proxmox.com/wiki/Package_Repositories

To be honest, in this case, it might be faster and especially easier to have recent and working backups and reinstall 8.2 directly...