Proxmox hangs after upgrade to v9

[yunmkfed]

Last Saturday I upgraded from Proxmox v8 to v9 based on the instructions downloaded from here. It went smoothly.

Today I noticed that the VM's and containers were down. The console had the following text on it and was not responsive.

The VM had been running smoothly without a hitch for months.

Any help to diagnose / resolve.

 

[Onslow]

In the photo I can see exim4. Proxmox itself uses Postfix, not Exim. Is your system a standalone Proxmox or Proxmox on top of Debian?

 

[yunmkfed]

Stand alone Proxmox

 

[Onslow]

Split locks are discussed e.g. here:

https://pve.proxmox.com/wiki/Split_lock_detection ||| https://forum.proxmox.com/threads/x86-split-lock-detection-log-entries-after-reboot.143863/ ||| https://forum.proxmox.com/threads/split-lock-detected-on-intel-xeon-silver-4310-cpus-under-load-in-proxmox-–-troubleshooting-steps.160931/

though they mention (artificial) slowdowns, not hanging...
I hope someone more experienced will help.

 

[yunmkfed]

Thanks. I'll wait for other inputs before making changes.

 

[yunmkfed]

I just took another photo of the console. While it is still responsive my console is generating warnings.

 

[readyspace]

Hi, looks like something happened during your upgrade between 8 to 9. Usually I'll do move out the VMs, then do a totally fresh install of PVE for major upgrade due to changes to the kernel.

 

[yunmkfed]

Hi, looks like something happened during your upgrade between 8 to 9. Usually I'll do move out the VMs, then do a totally fresh install of PVE for major upgrade due to changes to the kernel.

I am thinking along those lines.

Would you know what config files I can save (backups, file shares, etc) to avoid having to recreate them.

 

[readyspace]

For full-node rollback, a disk image (Clonezilla, etc.) is the quickest path.

 

[yunmkfed]

For full-node rollback, a disk image (Clonezilla, etc.) is the quickest path.

To confirm that I am following your suggestions correctly:

1. Backup the VM/CT's
2. Take a full image of the server using Clonezilla
3. Wipe the server and install VE 9.0
4. Open the Clonezilla Image (<<------ is this possible?)
5 Extract the config files related to backups, remote devices, etc (<<------ would you know where there are located/called please)
6. Transfer the config files from (5)
7. Restore the VM/CT's

Thanks

 

[readyspace]

Hi, I usually dont do this, i will only backup all the VMs, then format the node and install latest PVE. After that import the VMs back into the PVE. This way is cleaner.

 

[Onslow]

@yunmkfed You may have a look at the links in this post https://forum.proxmox.com/threads/backup-vms-and-containers-on-offline-node.173502/post-807371