I am not 100% certain as we as always in a hurry to get services back online when this happens but we have had several containers refuse to mount their LVM volume to start and this has happened multiple times.
I suspect this happens if the backup storage runs out of space during the nightly backups.
All checks upon the volume indicate that it is not mounted and nothing has it locked.
We cannot mount the volume by hand nor with pct.
fsck refuses to run.
A server reboot resolves the issue (but is obviously undesirable).
We have reduced the number of backups we keep to avoid running out of space.
I will follow-up with more details if it happens again this week.
I suspect this happens if the backup storage runs out of space during the nightly backups.
All checks upon the volume indicate that it is not mounted and nothing has it locked.
We cannot mount the volume by hand nor with pct.
fsck refuses to run.
A server reboot resolves the issue (but is obviously undesirable).
We have reduced the number of backups we keep to avoid running out of space.
I will follow-up with more details if it happens again this week.