ERROR: Backup of VM failed - job failed with err -5 - Input/output error

[fahadshery]

Hi,

I am unable to take a backup of my pfSense VM. About 50% and it throughs the error:

INFO: starting new backup job: vzdump 100 --storage backup --compress zstd --notes-template '{{guestname}} deploy to local-lvm' --remove 0 --node pve --mode snapshot
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2022-12-10 16:50:37
INFO: status = running
INFO: VM Name: pfSense
INFO: include disk 'scsi0' 'local-lvm:vm-100-disk-0' 32G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/backup/dump/vzdump-qemu-100-2022_12_10-16_50_37.vma.zst'
INFO: started backup task '0123bb57-6426-41f6-8e71-390379aca7e2'
INFO: resuming VM again
INFO:   3% (1.1 GiB of 32.0 GiB) in 3s, read: 386.7 MiB/s, write: 43.5 MiB/s
INFO:   4% (1.5 GiB of 32.0 GiB) in 6s, read: 141.4 MiB/s, write: 62.7 MiB/s
INFO:   5% (1.9 GiB of 32.0 GiB) in 9s, read: 124.5 MiB/s, write: 69.7 MiB/s
INFO:   7% (2.4 GiB of 32.0 GiB) in 12s, read: 174.0 MiB/s, write: 94.8 MiB/s
INFO:   9% (3.1 GiB of 32.0 GiB) in 15s, read: 226.0 MiB/s, write: 103.1 MiB/s

[SNIP]

INFO:  52% (16.9 GiB of 32.0 GiB) in 1m 12s, read: 308.1 MiB/s, write: 101.7 MiB/s
INFO:  55% (17.7 GiB of 32.0 GiB) in 1m 15s, read: 280.3 MiB/s, write: 102.1 MiB/s
INFO:  56% (18.2 GiB of 32.0 GiB) in 1m 18s, read: 177.6 MiB/s, write: 57.5 MiB/s
INFO:  57% (18.4 GiB of 32.0 GiB) in 1m 20s, read: 102.8 MiB/s, write: 44.6 MiB/s
ERROR: job failed with err -5 - Input/output error
INFO: aborting backup job
INFO: resuming VM again
ERROR: Backup of VM 100 failed - job failed with err -5 - Input/output error
INFO: Failed at 2022-12-10 16:51:57
INFO: Backup job finished with errors
TASK ERROR: job errors

Whereas if I take a backup of any other VM like piHole, some Ubuntu VMs, there are no problems.

I am taking the backups on a NFS mounted backup drive from my TrueNas VM!

pveversion -v
proxmox-ve: 7.3-1 (running kernel: 5.15.74-1-pve)
pve-manager: 7.3-3 (running version: 7.3-3/c3928077)
pve-kernel-5.15: 7.2-14
pve-kernel-helper: 7.2-14
pve-kernel-5.15.74-1-pve: 5.15.74-1
pve-kernel-5.15.64-1-pve: 5.15.64-1
pve-kernel-5.15.60-2-pve: 5.15.60-2
pve-kernel-5.15.39-3-pve: 5.15.39-3
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph-fuse: 15.2.16-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-5
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.3-1
libpve-guest-common-perl: 4.2-3
libpve-http-server-perl: 4.1-5
libpve-storage-perl: 7.3-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.3.1-1
proxmox-backup-file-restore: 2.3.1-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.0-1
proxmox-widget-toolkit: 3.5.3
pve-cluster: 7.3-1
pve-container: 4.4-2
pve-docs: 7.3-1
pve-edk2-firmware: 3.20220526-1
pve-firewall: 4.2-7
pve-firmware: 3.5-6
pve-ha-manager: 3.5.1
pve-i18n: 2.8-1
pve-qemu-kvm: 7.1.0-4
pve-xtermjs: 4.16.0-1
qemu-server: 7.3-1
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+2
vncterm: 1.7-1
zfsutils-linux: 2.1.6-pve1

What seems to be the issue?

 

[Moayad]

Hello,

ERROR: job failed with err -5 - Input/output error

I would check the storage using smartctl, since the above error might be an issue with the drive.

To narrow down the issue, you can test do a backup on a different storage.