backup/vzdump failed with err -5 - Input/output error

[snaz]

Hi

I’ve got 3 VMs and 2 containers running. I normally do backups onto a Synology NFS share. Both containers as well as one VM give me error 5 (below) when trying to back them up onto the NFS share. It can’t be a permission issue since two VMs work fine. It’s probably also not related to the NFS share since the error also happens when I backup them to "local". I’ve SMART tested my internal Proxmox drive as well as the NAS drives. My Proxmox installation is up to date (14.05.2021). I’ve also tried rebooting the Proxmox server.

INFO: 89% (44.7 GiB of 50.0 GiB) in 3m 26s, read: 47.5 MiB/s, write: 47.3 MiB/s
ERROR: job failed with err -5 - Input/output error
INFO: aborting backup job
INFO: resuming VM again
ERROR: Backup of VM 131 failed - job failed with err -5 - Input/output error
INFO: Failed at 2021-05-14 01:00:16
INFO: Backup job finished with errors
TASK ERROR: job errors

Has anybody here encountered this error and knows how to tackle it?

 

[dietmar]

Any hint in syslog?

 

[snaz]

Hmm there seems to be a problem with /dev/sda

kernel: ata1.00: irq_stat 0x40000008
kernel: ata1.00: failed command: READ FPDMA QUEUED
kernel: ata1.00: cmd 60/80:30:00:93:79/00:00:11:00:00/40 tag 6 ncq dma 65536 in
res 41/40:00:40:93:79/00:00:11:00:00/00 Emask 0x409 (media error) <F>
kernel: ata1.00: status: { DRDY ERR }
kernel: ata1.00: error: { UNC }
kernel: ata1.00: configured for UDMA/133
kernel: sd 0:0:0:0: [sda] tag#6 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
kernel: sd 0:0:0:0: [sda] tag#6 Sense Key : Medium Error [current]
kernel: sd 0:0:0:0: [sda] tag#6 Add. Sense: Unrecovered read error - auto reallocate failed
kernel: sd 0:0:0:0: [sda] tag#6 CDB: Read(10) 28 00 11 79 93 00 00 00 80 00
kernel: blk_update_request: I/O error, dev sda, sector 293180224 op 0x0READ) flags 0x0 phys_seg 8 prio class 0
kernel: ata1: EH complete
pvedaemon[5668]: ERROR: Backup of VM 131 failed - job failed with err -5 - Input/output error
pvedaemon[5668]: INFO: Backup job finished with errors
pvedaemon[5668]: job errors

 

[snaz]

I’ve now set a temp path inside /etc/vzdump.conf. That solves the problem partially. Both containers now backup successful but that one VM (131) still gives me error 5.