Backup of 1 Container started failing, other containers fine

[nix4me]

One of my 4 containers started failing backup. Here is the log output. This suddenly started happening.
2022-10-08 23:17:04 INFO: Starting Backup of VM 102 (lxc)
2022-10-08 23:17:04 INFO: status = running
2022-10-08 23:17:04 INFO: CT Name: plex
2022-10-08 23:17:04 INFO: including mount point rootfs ('/') in backup
2022-10-08 23:17:04 INFO: excluding bind mount point mp0 ('/mnt/fileserver/site/FLAC') from backup (not a volume)
2022-10-08 23:17:04 INFO: excluding bind mount point mp1 ('/mnt/fileserver/site/MP3') from backup (not a volume)
2022-10-08 23:17:04 INFO: excluding bind mount point mp2 ('/mnt/fileserver/site/TV') from backup (not a volume)
2022-10-08 23:17:04 INFO: excluding bind mount point mp3 ('/mnt/fileserver/site/MOVIES-HD') from backup (not a volume)
2022-10-08 23:17:04 INFO: backup mode: snapshot
2022-10-08 23:17:04 INFO: ionice priority: 7
2022-10-08 23:17:04 INFO: create storage snapshot 'vzdump'
2022-10-08 23:17:06 INFO: creating vzdump archive '/backup/dump/vzdump-lxc-102-2022_10_08-23_17_04.tar.zst'
2022-10-08 23:41:56 INFO: tar: ./var/lib/plex/Plex Media Server/Cache/PhotoTranscoder/de/de6e5696308e81722cdfe07d00eca78dafb83b11.jpg: File shrank by 204209 bytes; padding with zeros
2022-10-08 23:47:28 INFO: Total bytes written: 23261562880 (22GiB, 13MiB/s)
2022-10-08 23:47:29 INFO: cleanup temporary 'vzdump' snapshot
2022-10-08 23:47:33 ERROR: Backup of VM 102 failed - command 'set -o pipefail && tar cpf - --totals --one-file-system -p --sparse --numeric-owner --acls --xattrs '--xattrs-include=user.*' '--xattrs-include=security.capability' '--warning=no-file-ignored' '--warning=no-xattr-write' --one-file-system '--warning=no-file-ignored' '--directory=/var/tmp/vzdumptmp47665_102' ./etc/vzdump/pct.conf ./etc/vzdump/pct.fw '--directory=/mnt/vzsnap0' --no-anchored '--exclude=lost+found' --anchored '--exclude=./tmp/?*' '--exclude=./var/tmp/?*' '--exclude=./var/run/?*.pid' ./ | zstd --rsyncable '--threads=1' >/backup/dump/vzdump-lxc-102-2022_10_08-23_17_04.tar.dat' failed: exit code 1

Any idea why this is happening?

 

[fiona]

Hi,

2022-10-08 23:41:56 INFO: tar: ./var/lib/plex/Plex Media Server/Cache/PhotoTranscoder/de/de6e5696308e81722cdfe07d00eca78dafb83b11.jpg: File shrank by 204209 bytes; padding with zeros

this seems to be the problematic file, indicating that less data could be read than what the file should contain. What is the underlying storage the container uses? Does running pct fsck 102 when the container is shut down help?