Recent content by joed

  1. J

    Ceph Managers Seg Faulting Post Upgrade (8 -> 9 upgrade)

    Thank you for sharing this. This certainly resonates for me… I was fully patched on PVE 8.4.x for 3-4 days including Ceph 19.2.x and didn’t have any issues with ceph-mgr crashing until upgrading to PVE 9. Unfortunately, I don’t have careful notes of versions or good scientific testing to say...
  2. J

    Ceph Managers Seg Faulting Post Upgrade (8 -> 9 upgrade)

    One possibility for our differing experience... I had a job running that would create an ephemeral volume to do its work. This job runs semi-regularly, creating and deleting a PVC and therefore seemingly causing the ceph-mgr to crash each time it ran. I'm just curious, if this is something...
  3. J

    Ceph Managers Seg Faulting Post Upgrade (8 -> 9 upgrade)

    Interesting. I've never used snapshots other than a quick test when I first set it up about 4-5 years ago - I just noticed I don't even have a VolumeSnapshotClass on my cluster anymore... I did notice then when I first delete a PVC, the RBD is moved to the trash but there is a watcher on it...
  4. J

    Ceph Managers Seg Faulting Post Upgrade (8 -> 9 upgrade)

    Same issue here, with a couple of notes: I am using Kubernetes as well, and can relate the issue to something being in the rbd trash I've upgraded to the latest Ceph-CSI 3.14.2 and the problem still exists, although I don't notice anything in the release notes that looked related so this is...
  5. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    Thanks Thomas, that was indeed it. I upgraded pve-kernel-helper from 7.1-10 to 7.1-12 and the console output is working now. So, both the pve kernel and the pve-kernel-helper package need to be upgraded for this workaround. Thanks!
  6. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    5.15.19-2-pve did not resolve the issue with no console output for me. I had followed the work around above to add simplefb to /etc/initramfs-tools/modules, which successfully resolved the problem on both 5.15.17-1-pve and 5.15.19-1-pve. I started on a node running 5.15.19-1-pve with the...
  7. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    Thanks, this has restored my console output on both 5.15.17-1-pve and 5.15.19-1-pve. I do still have issues with the host node hanging with i915 passthrough since upgrading to PVE 7.1 (it was stable on 6.x and 7.0), though I wouldn't expect the hangs to be related to simplefb. The host node...
  8. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    Likewise for me, no console output after EFI stub: Loaded initrd from command line option, like I saw with pve-kernel-5.15.17-1. This time I typed my encryption passphrase in blindly and the machine booted normally. I'll have to test my i915 passthrough later.
  9. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    Interesting! My root ZFS pool is encrypted and requires that I enter the passphrase on the console before the machine will boot, so it is certainly possible that this was happening... without any output on the console I wouldn't be able to tell the difference between an outright hang versus...
  10. J

    Opt-in Linux Kernel 5.15 for Proxmox VE 7.x available

    I was having issues with a kernel oops followed by process hangs on 5.13.19-4-pve (although my node running 5.13.19-3-pve seems to be stable - touch wood). Error attached. The issue was reproducible on two systems and triggered when my IPMI removing its USB device when I closed the remote KVM...