ZFS mirrored boot disk full -- unable to boot

[Richard Peters]

I have a proxmox server running 6.1-8. The boot disk is a zfs mirror of 2 16GB satadoms. Unfortunately, I made a mistake and put a Splunk vm on the boot disk and it filled to 100%. I attempted to delete the vm but couldn't. I tried to reboot but now I cannot boot. Any ideas would be greatly appreciated.

 

[budy]

This is really bad, since you will have almost no choice than to provide more space to the ZFS pool, which in your case resides on a partition of the sata DOM and which you will likely be unable to expand. You would somehow need to add additional space to this pool. One possible way would be to add some space via the help of a USB thumb drive and then free up the space needed to remove the new vdev afterwards. 6.1-8 should have the latest zfs installed and that provides feature@device_removal.

However, you will likely have to boot your PVE from emergency system to be able to expand the rpool.

 

[Richard Peters]

I think the answer is to reinstall Proxmox. All of my VMs and container are stored remotely on a TrueNAS.

 

[budy]

It would be good though to have the vm configs before doing so and performing the addition of space to your rpool will do that - unless… you do have a good backup of your vm configs, then I'd concurr and re-installed pve as well.