Backup schlägt fehl - zstd: /*stdout*\: Input/output error

[Vengance]

Hallo,

Ich habe schon seit längerer Zeit Probleme mit dem Proxmox backup.
Proxmox hat zwei externe Storages hinterlegt, welche beide via CIFS angebunden sind.

Ein Storage bekommt ein nächtliches Backup aller VMs, der zweite Storage nur einer wichtige VM.
Das Backup auf den ersten Storage schlägt nahezu immer fehl und zeigt mir bei mindestens einer VM den status failed an.
Beim zweiten Storage hingegen gibt es keine Probleme.

PVE sowie alle Pakete sind auf der neusten version

Im log ist mir folgendes aufgefallen: zstd: /*stdout*\: Input/output error

NFO: Starting Backup of VM 102 (qemu)
INFO: Backup started at 2021-11-09 15:30:04
INFO: status = running
INFO: VM Name: web
INFO: include disk 'scsi0' 'local-zfs:vm-102-disk-0' 50G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/dus/dump/vzdump-qemu-102-2021_11_09-15_30_04.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '245bee36-2b10-4445-9718-87996c076033'
INFO: resuming VM again
INFO:   1% (790.2 MiB of 50.0 GiB) in 3s, read: 263.4 MiB/s, write: 208.6 MiB/s
INFO:   3% (1.5 GiB of 50.0 GiB) in 6s, read: 257.4 MiB/s, write: 217.8 MiB/s
INFO:   4% (2.4 GiB of 50.0 GiB) in 9s, read: 309.3 MiB/s, write: 256.4 MiB/s
INFO:   6% (3.4 GiB of 50.0 GiB) in 12s, read: 317.8 MiB/s, write: 294.0 MiB/s
INFO:   8% (4.3 GiB of 50.0 GiB) in 15s, read: 304.5 MiB/s, write: 269.4 MiB/s
INFO:  10% (5.2 GiB of 50.0 GiB) in 18s, read: 311.8 MiB/s, write: 304.9 MiB/s
INFO:  11% (5.8 GiB of 50.0 GiB) in 21s, read: 227.2 MiB/s, write: 224.1 MiB/s
INFO:  13% (6.6 GiB of 50.0 GiB) in 24s, read: 247.7 MiB/s, write: 205.4 MiB/s
INFO:  14% (7.1 GiB of 50.0 GiB) in 27s, read: 194.5 MiB/s, write: 193.8 MiB/s
INFO:  15% (7.7 GiB of 50.0 GiB) in 30s, read: 195.8 MiB/s, write: 194.6 MiB/s
INFO:  16% (8.4 GiB of 50.0 GiB) in 33s, read: 253.8 MiB/s, write: 217.3 MiB/s
INFO:  18% (9.1 GiB of 50.0 GiB) in 36s, read: 212.7 MiB/s, write: 212.6 MiB/s
INFO:  19% (9.8 GiB of 50.0 GiB) in 39s, read: 261.0 MiB/s, write: 260.9 MiB/s
INFO:  20% (10.5 GiB of 50.0 GiB) in 42s, read: 227.2 MiB/s, write: 184.8 MiB/s
INFO:  22% (11.2 GiB of 50.0 GiB) in 45s, read: 235.6 MiB/s, write: 235.6 MiB/s
INFO:  23% (12.0 GiB of 50.0 GiB) in 48s, read: 270.7 MiB/s, write: 270.6 MiB/s
INFO:  25% (12.8 GiB of 50.0 GiB) in 51s, read: 282.8 MiB/s, write: 241.8 MiB/s
INFO:  27% (13.5 GiB of 50.0 GiB) in 54s, read: 240.5 MiB/s, write: 240.4 MiB/s
INFO:  28% (14.3 GiB of 50.0 GiB) in 58s, read: 211.2 MiB/s, write: 180.3 MiB/s
INFO:  29% (14.8 GiB of 50.0 GiB) in 1m 1s, read: 152.2 MiB/s, write: 152.2 MiB/s
INFO:  30% (15.4 GiB of 50.0 GiB) in 1m 4s, read: 224.8 MiB/s, write: 224.4 MiB/s
INFO:  31% (15.9 GiB of 50.0 GiB) in 1m 7s, read: 170.4 MiB/s, write: 167.7 MiB/s
INFO:  32% (16.5 GiB of 50.0 GiB) in 1m 10s, read: 188.5 MiB/s, write: 150.3 MiB/s
INFO:  33% (16.9 GiB of 50.0 GiB) in 1m 13s, read: 137.8 MiB/s, write: 137.7 MiB/s
INFO:  34% (17.5 GiB of 50.0 GiB) in 1m 16s, read: 200.6 MiB/s, write: 200.5 MiB/s
INFO:  36% (18.2 GiB of 50.0 GiB) in 1m 19s, read: 232.0 MiB/s, write: 196.9 MiB/s
INFO:  37% (18.8 GiB of 50.0 GiB) in 1m 22s, read: 203.0 MiB/s, write: 202.9 MiB/s
INFO:  38% (19.2 GiB of 50.0 GiB) in 1m 25s, read: 165.5 MiB/s, write: 165.5 MiB/s
INFO:  39% (19.9 GiB of 50.0 GiB) in 1m 28s, read: 221.1 MiB/s, write: 220.5 MiB/s
INFO:  41% (20.7 GiB of 50.0 GiB) in 1m 31s, read: 281.5 MiB/s, write: 243.1 MiB/s
INFO:  42% (21.3 GiB of 50.0 GiB) in 1m 34s, read: 193.3 MiB/s, write: 193.3 MiB/s
INFO:  43% (21.8 GiB of 50.0 GiB) in 1m 37s, read: 192.1 MiB/s, write: 192.1 MiB/s
INFO:  45% (22.6 GiB of 50.0 GiB) in 1m 40s, read: 247.7 MiB/s, write: 208.9 MiB/s
INFO:  46% (23.2 GiB of 50.0 GiB) in 1m 43s, read: 229.6 MiB/s, write: 229.6 MiB/s
INFO:  47% (23.7 GiB of 50.0 GiB) in 1m 46s, read: 170.4 MiB/s, write: 170.4 MiB/s
INFO:  48% (24.4 GiB of 50.0 GiB) in 1m 49s, read: 226.0 MiB/s, write: 215.4 MiB/s
INFO:  50% (25.1 GiB of 50.0 GiB) in 1m 52s, read: 222.3 MiB/s, write: 222.3 MiB/s
INFO:  51% (25.6 GiB of 50.0 GiB) in 1m 58s, read: 84.0 MiB/s, write: 84.0 MiB/s
INFO:  52% (26.3 GiB of 50.0 GiB) in 2m 5s, read: 108.2 MiB/s, write: 91.8 MiB/s
INFO:  53% (26.9 GiB of 50.0 GiB) in 2m 8s, read: 198.2 MiB/s, write: 198.1 MiB/s
INFO:  55% (27.6 GiB of 50.0 GiB) in 2m 11s, read: 232.8 MiB/s, write: 232.8 MiB/s
INFO:  56% (28.3 GiB of 50.0 GiB) in 2m 14s, read: 263.9 MiB/s, write: 225.3 MiB/s
INFO:  58% (29.0 GiB of 50.0 GiB) in 2m 17s, read: 232.0 MiB/s, write: 232.0 MiB/s
INFO:  59% (29.8 GiB of 50.0 GiB) in 2m 20s, read: 263.4 MiB/s, write: 258.0 MiB/s
INFO:  60% (30.5 GiB of 50.0 GiB) in 2m 23s, read: 233.2 MiB/s, write: 193.0 MiB/s
INFO:  61% (30.8 GiB of 50.0 GiB) in 2m 26s, read: 122.0 MiB/s, write: 121.9 MiB/s
INFO:  62% (31.0 GiB of 50.0 GiB) in 2m 29s, read: 73.7 MiB/s, write: 73.7 MiB/s
INFO:  63% (31.5 GiB of 50.0 GiB) in 2m 39s, read: 52.6 MiB/s, write: 52.5 MiB/s
INFO:  64% (32.2 GiB of 50.0 GiB) in 2m 42s, read: 227.2 MiB/s, write: 188.3 MiB/s
INFO:  65% (32.8 GiB of 50.0 GiB) in 2m 45s, read: 197.0 MiB/s, write: 196.9 MiB/s
INFO:  67% (33.6 GiB of 50.0 GiB) in 2m 48s, read: 259.8 MiB/s, write: 259.7 MiB/s
INFO:  68% (34.3 GiB of 50.0 GiB) in 2m 51s, read: 262.2 MiB/s, write: 223.9 MiB/s
INFO:  69% (34.8 GiB of 50.0 GiB) in 2m 54s, read: 176.4 MiB/s, write: 175.4 MiB/s
INFO:  70% (35.2 GiB of 50.0 GiB) in 2m 57s, read: 124.5 MiB/s, write: 124.4 MiB/s
INFO:  71% (35.5 GiB of 50.0 GiB) in 3m 2s, read: 63.1 MiB/s, write: 63.0 MiB/s
INFO:  72% (36.2 GiB of 50.0 GiB) in 3m 11s, read: 81.4 MiB/s, write: 69.0 MiB/s
INFO:  73% (36.5 GiB of 50.0 GiB) in 3m 17s, read: 47.1 MiB/s, write: 47.1 MiB/s
INFO:  74% (37.0 GiB of 50.0 GiB) in 3m 25s, read: 64.3 MiB/s, write: 64.3 MiB/s
INFO:  75% (37.6 GiB of 50.0 GiB) in 3m 44s, read: 31.1 MiB/s, write: 31.1 MiB/s
INFO:  76% (38.2 GiB of 50.0 GiB) in 3m 51s, read: 83.4 MiB/s, write: 69.7 MiB/s
INFO:  77% (38.5 GiB of 50.0 GiB) in 3m 57s, read: 62.2 MiB/s, write: 62.2 MiB/s
INFO:  78% (39.0 GiB of 50.0 GiB) in 4m 10s, read: 38.2 MiB/s, write: 38.2 MiB/s
INFO:  79% (39.5 GiB of 50.0 GiB) in 4m 39s, read: 17.8 MiB/s, write: 17.7 MiB/s
INFO:  80% (40.2 GiB of 50.0 GiB) in 5m 6s, read: 28.2 MiB/s, write: 24.2 MiB/s
INFO:  81% (40.9 GiB of 50.0 GiB) in 5m 9s, read: 235.6 MiB/s, write: 235.6 MiB/s
INFO:  82% (41.4 GiB of 50.0 GiB) in 5m 12s, read: 160.7 MiB/s, write: 160.7 MiB/s
INFO:  83% (41.9 GiB of 50.0 GiB) in 5m 15s, read: 171.6 MiB/s, write: 171.6 MiB/s
INFO:  85% (42.6 GiB of 50.0 GiB) in 5m 18s, read: 250.1 MiB/s, write: 215.9 MiB/s
INFO:  86% (43.2 GiB of 50.0 GiB) in 5m 21s, read: 189.7 MiB/s, write: 188.3 MiB/s
INFO:  87% (43.8 GiB of 50.0 GiB) in 5m 24s, read: 193.3 MiB/s, write: 193.3 MiB/s
INFO:  89% (44.5 GiB of 50.0 GiB) in 5m 27s, read: 256.2 MiB/s, write: 221.5 MiB/s
INFO:  90% (45.1 GiB of 50.0 GiB) in 5m 31s, read: 159.5 MiB/s, write: 159.4 MiB/s
INFO:  91% (45.8 GiB of 50.0 GiB) in 5m 34s, read: 229.6 MiB/s, write: 229.3 MiB/s
INFO:  93% (46.5 GiB of 50.0 GiB) in 5m 37s, read: 251.3 MiB/s, write: 211.7 MiB/s
INFO:  94% (47.2 GiB of 50.0 GiB) in 5m 40s, read: 229.6 MiB/s, write: 229.5 MiB/s
INFO:  95% (47.9 GiB of 50.0 GiB) in 5m 43s, read: 247.7 MiB/s, write: 247.6 MiB/s
INFO:  97% (48.8 GiB of 50.0 GiB) in 5m 46s, read: 291.2 MiB/s, write: 253.3 MiB/s
INFO:  98% (49.4 GiB of 50.0 GiB) in 5m 49s, read: 221.1 MiB/s, write: 221.1 MiB/s
INFO:  99% (49.9 GiB of 50.0 GiB) in 5m 52s, read: 166.8 MiB/s, write: 166.8 MiB/s
INFO: 100% (50.0 GiB of 50.0 GiB) in 5m 53s, read: 65.8 MiB/s, write: 59.3 MiB/s
INFO: backup is sparse: 3.06 GiB (6%) total zero data
INFO: transferred 50.00 GiB in 353 seconds (145.0 MiB/s)
zstd: /*stdout*\: Input/output error
ERROR: Backup of VM 102 failed - zstd --rsyncable --threads=1 failed - wrong exit status 1
INFO: Failed at 2021-11-09 15:37:20

 

[Vengance]

Niemand eine Idee?

 

[tom]

PVE sowie alle Pakete sind auf der neusten version

Bitte immer auch die genaue Versionsnummern dazu posten, "neueste" Stand ändert sich oft.

=> pveversion -v

 

[Vengance]

proxmox-ve: 7.0-2 (running kernel: 5.11.22-5-pve)
pve-manager: 7.0-13 (running version: 7.0-13/7aa7e488)
pve-kernel-helper: 7.1-2
pve-kernel-5.11: 7.0-8
pve-kernel-5.4: 6.4-7
pve-kernel-5.11.22-5-pve: 5.11.22-10
pve-kernel-5.4.143-1-pve: 5.4.143-1
pve-kernel-5.4.140-1-pve: 5.4.140-1
pve-kernel-5.4.128-1-pve: 5.4.128-2
pve-kernel-5.4.124-1-pve: 5.4.124-2
pve-kernel-5.4.119-1-pve: 5.4.119-1
pve-kernel-5.4.114-1-pve: 5.4.114-1
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.73-1-pve: 5.4.73-1
ceph-fuse: 14.2.21-1
corosync: 3.1.5-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown: 0.8.36+pve1
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.22-pve1
libproxmox-acme-perl: 1.4.0
libproxmox-backup-qemu0: 1.2.0-1
libpve-access-control: 7.0-5
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.0-10
libpve-guest-common-perl: 4.0-2
libpve-http-server-perl: 4.0-3
libpve-storage-perl: 7.0-12
libqb0: 1.0.5-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 4.0.9-4
lxcfs: 4.0.8-pve2
novnc-pve: 1.2.0-3
proxmox-backup-client: 2.0.11-1
proxmox-backup-file-restore: 2.0.11-1
proxmox-mini-journalreader: 1.2-1
proxmox-widget-toolkit: 3.3-6
pve-cluster: 7.0-3
pve-container: 4.1-1
pve-docs: 7.0-5
pve-edk2-firmware: 3.20210831-1
pve-firewall: 4.2-4
pve-firmware: 3.3-2
pve-ha-manager: 3.3-1
pve-i18n: 2.5-1
pve-qemu-kvm: 6.0.0-4
pve-xtermjs: 4.12.0-1
qemu-server: 7.0-16
smartmontools: 7.2-pve2
spiceterm: 3.2-2
vncterm: 1.7-1
zfsutils-linux: 2.0.6-pve1~bpo10+1