IO error when I try to backup my vm after installing nvidia-drivers on the vm

[mmmmmmm]

Hi guys,
I've an error when I try to backup my vm the error message is : ERROR: job failed with err -5 - Input/output error
the vm have a nvidia A4000 passtrought
vm is debian 12
I did multiple tentative and the issue appear after installing nvidia-drivers on the vm before installing it the backup work as expected
otherwise the vm work well but i can't do a backup correctly
do you have an idea?
thanks

here my vm config

agent: enabled=1
boot: c
bootdisk: scsi0
ciuser: m
cores: 10
cpu: host
hostpci0: 0000:01:00
ide2: nvme1:vm-103-cloudinit,media=cdrom,size=4M
ipconfig0: ip=dhcp
machine: q35
memory: 20000
meta: creation-qemu=9.0.2,ctime=1739630101
name: docker-vm3
net0: virtio=BC:24:11:23:94:AD,bridge=vmbr0,tag=8
net1: virtio=BC:24:11:75:2B:FF,bridge=vmbr0
numa: 1
scsi0: nvme1:vm-103-disk-0,size=103G
scsihw: virtio-scsi-pci
smbios1: uuid=db0f3085-a5f2-4efa-85a9-ef7ad033f509
sockets: 1
sshkeys: ssh-ed25519%20AAAAC3NzaC1lZDI1NTE5AAAAIGXy2NUm86ZvIu8R1uDCjCq4nQamv8XK%2FyhS7I53uvN2%20m%40m%0A
vmgenid: 8a14585d-a3d1-459f-9c64-6ee19dd3217f

here the complet error message:

INFO: starting new backup job: vzdump 103 --node proxmox6 --remove 0 --notification-mode notification-system --notes-template '{{guestname}}' --compress zstd --storage mnas_backup_proxmox_hebdo --mode snapshot
INFO: Starting Backup of VM 103 (qemu)
INFO: Backup started at 2026-02-15 12:51:27
INFO: status = running
INFO: VM Name: docker-vm3
INFO: include disk 'scsi0' 'nvme1:vm-103-disk-0' 103G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/xxx/dump/vzdump-qemu-103-2026_02_15-12_51_27.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '4ffebf51-8dd8-4221-a217-4dfe70afdf3d'
INFO: resuming VM again
INFO:   1% (1.9 GiB of 103.0 GiB) in 3s, read: 642.8 MiB/s, write: 452.4 MiB/s
INFO:   3% (3.6 GiB of 103.0 GiB) in 6s, read: 586.0 MiB/s, write: 452.3 MiB/s
INFO:   3% (3.8 GiB of 103.0 GiB) in 7s, read: 175.4 MiB/s, write: 165.2 MiB/s
ERROR: job failed with err -5 - Input/output error
INFO: aborting backup job
INFO: resuming VM again
ERROR: Backup of VM 103 failed - job failed with err -5 - Input/output error
INFO: Failed at 2026-02-15 12:51:36
INFO: Backup job finished with errors
INFO: skipping disabled target 'mail-to-root'
TASK ERROR: job errors

 

[fba]

Hi,
try it with switching the SCSI Controller to VirtIO SCSI Single and enable IO Thread on the disk or use a different backup mode.

 

[mmmmmmm]

Hi,
I tested to VirtIO SCSI Single and enable IO Thread the disks
and changed backup mode to suspend or stop and it's the same

it was working before, when I was with pve8 and now with pve9 I have those errors

 

[fba]

Hi,
if the same error is triggered in stop mode for backup the underlying storage or connection to the target storage might be the culprit. I would check smart values of the disk first.
Have you tried restoring the last backup?

 

[mmmmmmm]

I've installed vm from template, did backup at every step, i've tried to restore previous backup and it worked
I've tried to backup it on another location and same error
i will try to move from this sources to another and test again
thanks