Virtual machine freezes with IO error

[uzisuicida]

Hello everyone,

I'm having problems with only one virtual machine. After several days, it displays the error: Status: io-error. I've checked the disk and there's no problem there. It only happens with this machine. After shutting it down and turning it back on, it continues to function normally.



I have no idea what to check.

Thanks!

 

[d.oishi]

Are there any errors in `journalctl` or `dmesg`?
You can gather the VM configuration/status and the storage status with the following commands:

qm status $VMID --verbose
qm config $VMID
qm showcmd $VMID --pretty
pvesm status

 

[uzisuicida]

Hello d.oshi,

No errors were observed with journalctl or dmesg.
I also don't see any errors with the commands you sent me, unless I don't know how to interpret them; I've attached a file with the output of each command.

Thanks!

 

[cwt]

Your VM is on the local-lvm which is not really suitable for VM storage.

If the error re-occurs look for storage related messages:

dmesg -T | egrep -i "error|fail|reset|nvme|sd"

The log indicates slow writes:

wr_operations: 802447
wr_total_time_ns: 1731275382833

That‘s around 2ms per write. And this:

account_failed: 1
account_invalid: 1

comes directly from the QEMU block-layer and means that there was an IO error.

How does did you setup your storage for local-lvm? NVME? SSD?

 

[Impact]

There does not seem to be a local-lvm. Also why would local-lvm not be suitable? For local I agree.

 

[uzisuicida]

Hello cwt,

Attached is the result of dmesg grep, at this moment it froze again, I turned it off and on again.

Thanks!