First kernel update after upgrading 7.4 to 8.1 failing: /var/tmp/espmounts/... mounted read-only

[poppadum]

Just doing my first updates since upgrading a node from 7.4 to 8.1.4 and I'm getting the following error from dpkg when it tries to install proxmox-kernel-6.5.13-1-pve-signed:

Setting up proxmox-kernel-6.5.13-1-pve-signed (6.5.13-1) ...
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 6.5.13-1-pve /boot/vmlinuz-6.5.13-1-pve
update-initramfs: Generating /boot/initrd.img-6.5.13-1-pve
Running hook script 'zz-proxmox-boot'..
Re-executing '/etc/kernel/postinst.d/zz-proxmox-boot' in new private mount namespace..
No /etc/kernel/cmdline found - falling back to /proc/cmdline
mount: /var/tmp/espmounts/E283-6152: WARNING: source write-protected, mounted read-only.
Copying and configuring kernels on /dev/disk/by-uuid/E283-6152
        Copying kernel 5.15.136-1-pve
cp: cannot create regular file '/var/tmp/espmounts/E283-6152/vmlinuz-5.15.136-1-pve': Read-only file system
run-parts: /etc/initramfs/post-update.d//proxmox-boot-sync exited with return code 1
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 1
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/proxmox-kernel-6.5.13-1-pve-signed.postinst line 20.
dpkg: error processing package proxmox-kernel-6.5.13-1-pve-signed (--configure):
 installed proxmox-kernel-6.5.13-1-pve-signed package post-installation script subprocess returned error exit status 2
dpkg: dependency problems prevent configuration of proxmox-kernel-6.5:
 proxmox-kernel-6.5 depends on proxmox-kernel-6.5.13-1-pve-signed | proxmox-kernel-6.5.13-1-pve; however:
  Package proxmox-kernel-6.5.13-1-pve-signed is not configured yet.
  Package proxmox-kernel-6.5.13-1-pve is not installed.
  Package proxmox-kernel-6.5.13-1-pve-signed which provides proxmox-kernel-6.5.13-1-pve is not configured yet.

dpkg: error processing package proxmox-kernel-6.5 (--configure):
 dependency problems - leaving unconfigured

The node boots from legacy BIOS, zfs on root:

# lsblk -o +FSTYPE /dev/sdd
NAME   MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS FSTYPE
sdd      8:48   0 223.6G  0 disk            
|-sdd1   8:49   0  1007K  0 part            
|-sdd2   8:50   0   512M  0 part /boot/efi   vfat
`-sdd3   8:51   0 223.1G  0 part

# proxmox-boot-tool status
Re-executing '/usr/sbin/proxmox-boot-tool' in new private mount namespace..
System currently booted with legacy bios
mount: /var/tmp/espmounts/E283-6152: WARNING: source write-protected, mounted read-only.
E283-6152 is configured with: uefi (versions: 5.4.101-1-pve, 5.4.106-1-pve), grub (versions: 5.15.131-2-pve, 5.15.136-1-pve, 6.5.11-8-pve)

EFI partition looks to have plenty of space (but it is mounted read-only):

# df -h /boot/efi/
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdd2       511M  335M  177M  66% /boot/efi

Version:

# pveversion
pve-manager/8.1.4/ec5affc9e41f1d79 (running kernel: 6.5.11-8-pve)

When apt is not running, nothing is mounted in /var/tmp/espmounts/E283-6152

Is it safe to remount /boot/efi as read/write and run apt update again?

 

[poppadum]

Looking back over the apt log from the upgrade to 8.1, it looks as though the grub install went OK:

grub-pc: Running grub-install ...
This system is booted via proxmox-boot-tool, running proxmox-boot-tool init for all configured bootdisks
Re-executing '/usr/sbin/proxmox-boot-tool' in new private mount namespace..
UUID="E283-6152" SIZE="536870912" FSTYPE="vfat" PARTTYPE="c12a7328-f81f-11d2-ba4b-00a0c93ec93b" PKNAME="sdd" MOUNTPOINT=""
Mounting '/dev/disk/by-uuid/E283-6152' on '/var/tmp/espmounts/E283-6152'.
Installing grub i386-pc target..
Installing for i386-pc platform.
Installation finished. No error reported.
Unmounting '/dev/disk/by-uuid/E283-6152'.
Adding '/dev/disk/by-uuid/E283-6152' to list of synced ESPs..
Running hook script 'proxmox-auto-removal'..
Running hook script 'zz-proxmox-boot'..
Re-executing '/etc/kernel/postinst.d/zz-proxmox-boot' in new private mount namespace..
No /etc/kernel/cmdline found - falling back to /proc/cmdline
Copying and configuring kernels on /dev/disk/by-uuid/E283-6152
        Copying kernel 5.15.131-2-pve
        Copying kernel 5.15.136-1-pve
        Copying kernel 6.5.11-8-pve
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.5.11-8-pve
Found initrd image: /boot/initrd.img-6.5.11-8-pve
Found linux image: /boot/vmlinuz-5.15.136-1-pve
Found initrd image: /boot/initrd.img-5.15.136-1-pve
Found linux image: /boot/vmlinuz-5.15.131-2-pve
Found initrd image: /boot/initrd.img-5.15.131-2-pve
Warning: os-prober will not be executed to detect other bootable partitions.
Systems on them will not be added to the GRUB boot configuration.
Check GRUB_DISABLE_OS_PROBER documentation entry.
done
  grub-install success for /dev/sdd
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.5.11-8-pve
Found initrd image: /boot/initrd.img-6.5.11-8-pve
Found linux image: /boot/vmlinuz-5.15.136-1-pve
Found initrd image: /boot/initrd.img-5.15.136-1-pve
Found linux image: /boot/vmlinuz-5.15.131-2-pve
Found initrd image: /boot/initrd.img-5.15.131-2-pve
Found linux image: /boot/vmlinuz-5.4.203-1-pve
Found initrd image: /boot/initrd.img-5.4.203-1-pve
Found linux image: /boot/vmlinuz-5.4.34-1-pve
Found initrd image: /boot/initrd.img-5.4.34-1-pve
Found memtest86+x64 image: /ROOT/pve-1@/boot/memtest86+x64.bin
Warning: os-prober will not be executed to detect other bootable partitions.
Systems on them will not be added to the GRUB boot configuration.
Check GRUB_DISABLE_OS_PROBER documentation entry.
done

 

[MasterCATZ]

mount: /var/tmp/espmounts/***: WARNING: source write-protected, mounted read-only.
this is causing updates to fail

so pretty much stuck in the same pickle going 8 to 8.2
mine is meant to be legacy I have no efi


proxmox-boot-tool status

however mine is not saying RO when running that tool
and I was able to create and delete files and folders in that path

Re-executing '/usr/sbin/proxmox-boot-tool' in new private mount namespace..
System currently booted with legacy bios
43E5-6E0F is configured with: grub (versions: 6.2.16-20-pve, 6.8.8-2-pve)