My scheduled backup went error and i do not know what is happening. It shows errors like this:
Please help me, thank you guys!
Code:
INFO: starting new backup job: vzdump 118 --prune-backups 'keep-last=1' --mode snapshot --node Proxmox102 --quiet 1 --mailnotification always --storage BackupVM_PC6_2 --notes-template '{{guestname}}' --compress zstd
INFO: Starting Backup of VM 118 (qemu)
INFO: Backup started at 2024-07-03 03:00:07
INFO: status = running
INFO: VM Name: Staging-250
INFO: include disk 'scsi0' 'truenas_2TB:118/vm-118-disk-0.qcow2' 700G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/BackupVM_PC6_2/dump/vzdump-qemu-118-2024_07_03-03_00_07.vma.zst'
INFO: started backup task '4dd775f1-59a6-45e8-9597-9243fb601bd0'
INFO: resuming VM again
INFO: 0% (366.1 MiB of 700.0 GiB) in 3s, read: 122.0 MiB/s, write: 71.8 MiB/s
INFO: 1% (7.0 GiB of 700.0 GiB) in 1m 5s, read: 110.3 MiB/s, write: 89.1 MiB/s
INFO: 2% (14.1 GiB of 700.0 GiB) in 2m 10s, read: 111.4 MiB/s, write: 110.8 MiB/s
INFO: 3% (21.0 GiB of 700.0 GiB) in 4m 7s, read: 60.7 MiB/s, write: 60.3 MiB/s
INFO: 4% (28.1 GiB of 700.0 GiB) in 7m 19s, read: 37.4 MiB/s, write: 37.0 MiB/s
INFO: 5% (35.0 GiB of 700.0 GiB) in 10m 21s, read: 39.1 MiB/s, write: 38.7 MiB/s
INFO: 6% (42.0 GiB of 700.0 GiB) in 13m 11s, read: 42.3 MiB/s, write: 41.9 MiB/s
INFO: 7% (49.0 GiB of 700.0 GiB) in 16m 11s, read: 39.9 MiB/s, write: 39.4 MiB/s
INFO: 8% (56.0 GiB of 700.0 GiB) in 19m 25s, read: 36.9 MiB/s, write: 36.5 MiB/s
INFO: 9% (63.1 GiB of 700.0 GiB) in 20m 45s, read: 90.4 MiB/s, write: 48.8 MiB/s
INFO: 10% (70.0 GiB of 700.0 GiB) in 23m 38s, read: 40.9 MiB/s, write: 40.3 MiB/s
INFO: 11% (77.0 GiB of 700.0 GiB) in 26m 20s, read: 44.2 MiB/s, write: 43.7 MiB/s
INFO: 12% (84.0 GiB of 700.0 GiB) in 29m 14s, read: 41.2 MiB/s, write: 40.8 MiB/s
INFO: 13% (91.0 GiB of 700.0 GiB) in 32m 15s, read: 39.7 MiB/s, write: 39.2 MiB/s
INFO: 14% (98.0 GiB of 700.0 GiB) in 35m 21s, read: 38.6 MiB/s, write: 38.2 MiB/s
INFO: 15% (105.0 GiB of 700.0 GiB) in 38m 31s, read: 37.7 MiB/s, write: 37.2 MiB/s
INFO: 16% (112.0 GiB of 700.0 GiB) in 41m 44s, read: 37.1 MiB/s, write: 36.7 MiB/s
INFO: 17% (119.1 GiB of 700.0 GiB) in 44m 48s, read: 39.2 MiB/s, write: 38.5 MiB/s
INFO: 18% (126.0 GiB of 700.0 GiB) in 47m 48s, read: 39.5 MiB/s, write: 39.0 MiB/s
INFO: 19% (133.0 GiB of 700.0 GiB) in 50m 49s, read: 39.7 MiB/s, write: 39.0 MiB/s
INFO: 20% (140.0 GiB of 700.0 GiB) in 53m 59s, read: 37.7 MiB/s, write: 37.2 MiB/s
INFO: 21% (147.0 GiB of 700.0 GiB) in 56m 58s, read: 40.2 MiB/s, write: 39.5 MiB/s
INFO: 22% (154.0 GiB of 700.0 GiB) in 1h 11s, read: 37.1 MiB/s, write: 36.6 MiB/s
INFO: 23% (161.0 GiB of 700.0 GiB) in 1h 3m 17s, read: 38.5 MiB/s, write: 37.8 MiB/s
INFO: 24% (168.0 GiB of 700.0 GiB) in 1h 6m 19s, read: 39.5 MiB/s, write: 38.9 MiB/s
INFO: 25% (175.0 GiB of 700.0 GiB) in 1h 9m 18s, read: 39.9 MiB/s, write: 39.2 MiB/s
INFO: 26% (182.0 GiB of 700.0 GiB) in 1h 12m 30s, read: 37.3 MiB/s, write: 36.8 MiB/s
INFO: 27% (189.0 GiB of 700.0 GiB) in 1h 15m 43s, read: 37.1 MiB/s, write: 36.5 MiB/s
INFO: 28% (196.0 GiB of 700.0 GiB) in 1h 18m 58s, read: 36.8 MiB/s, write: 36.3 MiB/s
INFO: 29% (203.0 GiB of 700.0 GiB) in 1h 22m 8s, read: 37.7 MiB/s, write: 37.0 MiB/s
INFO: 30% (210.0 GiB of 700.0 GiB) in 1h 25m 17s, read: 38.1 MiB/s, write: 37.6 MiB/s
INFO: 31% (217.0 GiB of 700.0 GiB) in 1h 28m 7s, read: 42.1 MiB/s, write: 40.7 MiB/s
INFO: 32% (224.0 GiB of 700.0 GiB) in 1h 31m 11s, read: 38.9 MiB/s, write: 38.4 MiB/s
INFO: 33% (231.0 GiB of 700.0 GiB) in 1h 34m 24s, read: 37.1 MiB/s, write: 36.5 MiB/s
INFO: 34% (238.0 GiB of 700.0 GiB) in 1h 37m 20s, read: 40.6 MiB/s, write: 40.2 MiB/s
INFO: 35% (245.0 GiB of 700.0 GiB) in 1h 40m 14s, read: 41.4 MiB/s, write: 40.6 MiB/s
INFO: 36% (252.0 GiB of 700.0 GiB) in 1h 42m 47s, read: 46.8 MiB/s, write: 46.2 MiB/s
INFO: 37% (259.0 GiB of 700.0 GiB) in 1h 45m 32s, read: 43.4 MiB/s, write: 42.6 MiB/s
INFO: 38% (266.1 GiB of 700.0 GiB) in 1h 48m 25s, read: 41.7 MiB/s, write: 40.9 MiB/s
INFO: 39% (273.0 GiB of 700.0 GiB) in 1h 51m 25s, read: 39.6 MiB/s, write: 39.1 MiB/s
INFO: 40% (280.1 GiB of 700.0 GiB) in 1h 54m 30s, read: 39.1 MiB/s, write: 38.3 MiB/s
INFO: 41% (287.0 GiB of 700.0 GiB) in 1h 57m 24s, read: 40.9 MiB/s, write: 40.3 MiB/s
INFO: 42% (294.0 GiB of 700.0 GiB) in 2h 12s, read: 42.6 MiB/s, write: 42.0 MiB/s
INFO: 43% (301.0 GiB of 700.0 GiB) in 2h 3m 10s, read: 40.4 MiB/s, write: 39.6 MiB/s
INFO: 44% (308.0 GiB of 700.0 GiB) in 2h 6m 8s, read: 40.3 MiB/s, write: 39.7 MiB/s
INFO: 45% (315.0 GiB of 700.0 GiB) in 2h 9m 5s, read: 40.5 MiB/s, write: 39.8 MiB/s
INFO: 46% (322.0 GiB of 700.0 GiB) in 2h 11m 59s, read: 41.1 MiB/s, write: 40.6 MiB/s
INFO: 47% (329.0 GiB of 700.0 GiB) in 2h 14m 54s, read: 41.1 MiB/s, write: 40.4 MiB/s
INFO: 48% (336.0 GiB of 700.0 GiB) in 2h 17m 41s, read: 42.8 MiB/s, write: 42.2 MiB/s
INFO: 49% (343.0 GiB of 700.0 GiB) in 2h 20m 35s, read: 41.3 MiB/s, write: 40.6 MiB/s
INFO: 50% (350.1 GiB of 700.0 GiB) in 2h 23m 23s, read: 42.9 MiB/s, write: 42.1 MiB/s
INFO: 51% (357.0 GiB of 700.0 GiB) in 2h 26m 24s, read: 39.4 MiB/s, write: 38.8 MiB/s
INFO: 52% (364.1 GiB of 700.0 GiB) in 2h 29m 19s, read: 41.2 MiB/s, write: 40.4 MiB/s
INFO: 53% (371.0 GiB of 700.0 GiB) in 2h 32m 24s, read: 38.4 MiB/s, write: 37.9 MiB/s
INFO: 54% (378.1 GiB of 700.0 GiB) in 2h 35m 27s, read: 39.5 MiB/s, write: 38.8 MiB/s
INFO: 55% (385.0 GiB of 700.0 GiB) in 2h 38m 33s, read: 38.1 MiB/s, write: 37.6 MiB/s
INFO: 56% (392.0 GiB of 700.0 GiB) in 2h 41m 39s, read: 38.5 MiB/s, write: 38.0 MiB/s
INFO: 57% (399.0 GiB of 700.0 GiB) in 2h 44m 55s, read: 36.7 MiB/s, write: 36.0 MiB/s
INFO: 58% (406.0 GiB of 700.0 GiB) in 2h 48m 6s, read: 37.4 MiB/s, write: 36.9 MiB/s
INFO: 59% (413.0 GiB of 700.0 GiB) in 2h 51m 15s, read: 38.0 MiB/s, write: 37.3 MiB/s
INFO: 60% (420.1 GiB of 700.0 GiB) in 2h 54m 9s, read: 41.5 MiB/s, write: 40.7 MiB/s
INFO: 61% (427.0 GiB of 700.0 GiB) in 2h 57m 24s, read: 36.5 MiB/s, write: 36.0 MiB/s
INFO: 62% (434.0 GiB of 700.0 GiB) in 3h 35s, read: 37.5 MiB/s, write: 37.0 MiB/s
INFO: 63% (441.0 GiB of 700.0 GiB) in 3h 35m 14s, read: 3.5 MiB/s, write: 3.3 MiB/s
INFO: 64% (448.1 GiB of 700.0 GiB) in 3h 38m 9s, read: 41.2 MiB/s, write: 40.2 MiB/s
INFO: 65% (455.1 GiB of 700.0 GiB) in 3h 40m 32s, read: 50.1 MiB/s, write: 49.4 MiB/s
INFO: 66% (462.1 GiB of 700.0 GiB) in 3h 42m 52s, read: 51.4 MiB/s, write: 50.4 MiB/s
INFO: 67% (469.0 GiB of 700.0 GiB) in 3h 44m 55s, read: 57.7 MiB/s, write: 56.9 MiB/s
INFO: 68% (476.1 GiB of 700.0 GiB) in 3h 47m 14s, read: 52.1 MiB/s, write: 51.1 MiB/s
INFO: 69% (483.1 GiB of 700.0 GiB) in 3h 49m 35s, read: 50.8 MiB/s, write: 50.0 MiB/s
INFO: 70% (490.1 GiB of 700.0 GiB) in 3h 52m, read: 49.5 MiB/s, write: 48.6 MiB/s
INFO: 71% (497.0 GiB of 700.0 GiB) in 3h 54m 24s, read: 49.3 MiB/s, write: 48.5 MiB/s
INFO: 72% (504.1 GiB of 700.0 GiB) in 3h 56m 56s, read: 47.7 MiB/s, write: 46.9 MiB/s
INFO: 73% (511.0 GiB of 700.0 GiB) in 3h 59m 25s, read: 47.7 MiB/s, write: 47.1 MiB/s
INFO: 74% (518.1 GiB of 700.0 GiB) in 4h 1m 59s, read: 46.7 MiB/s, write: 45.9 MiB/s
INFO: 75% (525.0 GiB of 700.0 GiB) in 4h 4m 27s, read: 48.3 MiB/s, write: 47.6 MiB/s
INFO: 76% (532.1 GiB of 700.0 GiB) in 4h 6m 56s, read: 48.2 MiB/s, write: 47.3 MiB/s
INFO: 77% (539.0 GiB of 700.0 GiB) in 4h 9m 27s, read: 47.1 MiB/s, write: 46.5 MiB/s
INFO: 78% (546.1 GiB of 700.0 GiB) in 4h 11m 58s, read: 47.8 MiB/s, write: 46.9 MiB/s
INFO: 79% (553.0 GiB of 700.0 GiB) in 4h 14m 25s, read: 48.4 MiB/s, write: 47.7 MiB/s
INFO: 80% (560.1 GiB of 700.0 GiB) in 4h 16m 51s, read: 49.5 MiB/s, write: 48.6 MiB/s
INFO: 81% (567.0 GiB of 700.0 GiB) in 4h 19m 21s, read: 47.5 MiB/s, write: 46.8 MiB/s
INFO: 82% (574.1 GiB of 700.0 GiB) in 4h 21m 51s, read: 48.1 MiB/s, write: 47.3 MiB/s
INFO: 83% (581.0 GiB of 700.0 GiB) in 4h 24m 21s, read: 47.4 MiB/s, write: 46.7 MiB/s
INFO: 84% (588.0 GiB of 700.0 GiB) in 4h 26m 49s, read: 48.7 MiB/s, write: 47.8 MiB/s
INFO: 85% (595.0 GiB of 700.0 GiB) in 4h 29m 16s, read: 48.6 MiB/s, write: 47.9 MiB/s
INFO: 86% (602.0 GiB of 700.0 GiB) in 4h 31m 49s, read: 47.0 MiB/s, write: 46.1 MiB/s
INFO: 87% (609.0 GiB of 700.0 GiB) in 4h 34m 18s, read: 48.0 MiB/s, write: 47.2 MiB/s
INFO: 88% (616.0 GiB of 700.0 GiB) in 4h 36m 47s, read: 48.0 MiB/s, write: 47.3 MiB/s
INFO: 89% (623.0 GiB of 700.0 GiB) in 4h 39m 15s, read: 48.6 MiB/s, write: 47.7 MiB/s
INFO: 90% (630.1 GiB of 700.0 GiB) in 4h 41m 44s, read: 48.3 MiB/s, write: 47.4 MiB/s
INFO: 91% (637.0 GiB of 700.0 GiB) in 4h 44m 13s, read: 47.8 MiB/s, write: 47.1 MiB/s
INFO: 92% (644.0 GiB of 700.0 GiB) in 4h 46m 40s, read: 49.0 MiB/s, write: 48.1 MiB/s
INFO: 93% (651.0 GiB of 700.0 GiB) in 4h 49m 10s, read: 47.5 MiB/s, write: 46.8 MiB/s
INFO: 94% (658.1 GiB of 700.0 GiB) in 5h 1m 40s, read: 9.6 MiB/s, write: 9.5 MiB/s
INFO: 95% (668.2 GiB of 700.0 GiB) in 5h 2m 44s, read: 161.7 MiB/s, write: 53.0 MiB/s
INFO: 96% (672.0 GiB of 700.0 GiB) in 5h 3m 16s, read: 123.8 MiB/s, write: 100.1 MiB/s
INFO: 97% (679.0 GiB of 700.0 GiB) in 5h 4m 41s, read: 83.9 MiB/s, write: 74.7 MiB/s
INFO: 98% (687.0 GiB of 700.0 GiB) in 5h 4m 46s, read: 1.6 GiB/s, write: 56.3 MiB/s
INFO: 100% (700.0 GiB of 700.0 GiB) in 5h 4m 49s, read: 4.3 GiB/s, write: 27.1 MiB/s
INFO: backup is sparse: 43.73 GiB (6%) total zero data
INFO: transferred 700.00 GiB in 18289 seconds (39.2 MiB/s)
zstd: /*stdout*\: Input/output error
ERROR: Backup of VM 118 failed - zstd --rsyncable --threads=1 failed - wrong exit status 1
INFO: Failed at 2024-07-03 08:07:16
INFO: Backup job finished with errors
TASK ERROR: job errors