buffer I/O error sda1 (in guest)

[ezh]

A big problem appeared today.

1. Those errors appear in console:
a)


b)


2. It is a LVM-Thin device, that Proxmox shows as 100% usage:


3. Device information shows 325Gb (actually it is a 300Gb WD Velociraptor RAID-1 HDD):


4. lvs -a output from the host, shows 100% of some 185 Gb "data" disk (it showld be 300Gb):


5. df from guest:


I do not understand why Proxmox shows 185Gb LVM? Why are those errors? Cause of 100% full LVM?

What should I do?

Tnx.

 

[sb-jw]

You have to understand LVM: https://debian-administration.org/article/410/A_simple_introduction_to_working_with_LVM

You need to reorganize your volumes.

 

[ezh]

Could you please tell me what I have to do right now to get the server back online?

 

[danielb]

If your thin pool has been saturated (as it seems to be), there are good chances your guests filesystems are now corrupted

 

[sb-jw]

I thought your disk is in real full, so you have 300GB and currently you have with data, swap and PVE root around 262GB available.

You can try to delete files innert the VM or use fstrim (only possible if you have SCSI and Discard enabled on the virtual disk). Otherwise you can try to reduce the PVE root volume and add this free space to data volume. You can delete the swap volume too and add swap afterwards as a file or a smaller volume. But at this point, I can only repeat me, you have to understand LVM.

Or you expand it with additional disks or bigger one.