hello
i've a problem with backup. when the VM is largher then 1TB
INFO: starting new backup job: vzdump 132 --storage vm-backup --mailto mymail --mailnotification always --mode snapshot --compress zstd --quiet 1
INFO: Starting Backup of VM 132 (qemu)
INFO: Backup started at 2021-12-27 00:00:02
INFO: status = running
INFO: VM Name: mailstore9
INFO: include disk 'virtio0' 'CEPH_Local:vm-132-disk-0' 40G
INFO: include disk 'virtio1' 'CEPH_Local:vm-132-disk-1' 1540G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/vm-backup/dump/vzdump-qemu-132-2021_12_27-00_00_02.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '11ea62b7-d836-4beb-bb3f-506ecce3537a'
INFO: resuming VM again
INFO: 0% (764.9 MiB of 1.5 TiB) in 3s, read: 255.0 MiB/s, write: 234.2 MiB/s
INFO: 1% (15.9 GiB of 1.5 TiB) in 1m 22s, read: 196.4 MiB/s, write: 196.4 MiB/s
INFO: 2% (31.7 GiB of 1.5 TiB) in 2m 44s, read: 197.3 MiB/s, write: 197.3 MiB/s
INFO: 3% (47.5 GiB of 1.5 TiB) in 4m 7s, read: 194.5 MiB/s, write: 194.5 MiB/s
INFO: 4% (63.2 GiB of 1.5 TiB) in 5m 36s, read: 181.2 MiB/s, write: 181.2 MiB/s
INFO: 5% (79.1 GiB of 1.5 TiB) in 7m 4s, read: 185.0 MiB/s, write: 185.0 MiB/s
INFO: 6% (95.0 GiB of 1.5 TiB) in 8m 32s, read: 184.5 MiB/s, write: 184.5 MiB/s
INFO: 7% (110.7 GiB of 1.5 TiB) in 9m 58s, read: 187.1 MiB/s, write: 187.1 MiB/s
INFO: 8% (126.5 GiB of 1.5 TiB) in 12m 15s, read: 118.3 MiB/s, write: 118.3 MiB/s
INFO: 9% (142.3 GiB of 1.5 TiB) in 13m 44s, read: 181.5 MiB/s, write: 181.5 MiB/s
INFO: 10% (158.2 GiB of 1.5 TiB) in 15m 11s, read: 187.0 MiB/s, write: 187.0 MiB/s
INFO: 11% (173.9 GiB of 1.5 TiB) in 16m 34s, read: 194.3 MiB/s, write: 194.3 MiB/s
INFO: 12% (189.7 GiB of 1.5 TiB) in 17m 59s, read: 190.7 MiB/s, write: 190.7 MiB/s
INFO: 13% (205.5 GiB of 1.5 TiB) in 19m 22s, read: 194.5 MiB/s, write: 194.5 MiB/s
INFO: 14% (221.2 GiB of 1.5 TiB) in 20m 44s, read: 196.0 MiB/s, write: 196.0 MiB/s
INFO: 15% (237.1 GiB of 1.5 TiB) in 22m 8s, read: 194.1 MiB/s, write: 194.1 MiB/s
INFO: 16% (252.9 GiB of 1.5 TiB) in 23m 32s, read: 191.8 MiB/s, write: 191.8 MiB/s
INFO: 17% (268.6 GiB of 1.5 TiB) in 24m 56s, read: 192.4 MiB/s, write: 192.4 MiB/s
INFO: 18% (284.5 GiB of 1.5 TiB) in 26m 21s, read: 191.5 MiB/s, write: 191.5 MiB/s
INFO: 19% (300.3 GiB of 1.5 TiB) in 27m 45s, read: 191.6 MiB/s, write: 191.6 MiB/s
INFO: 20% (316.1 GiB of 1.5 TiB) in 29m 8s, read: 195.2 MiB/s, write: 195.2 MiB/s
INFO: 21% (331.9 GiB of 1.5 TiB) in 30m 32s, read: 193.5 MiB/s, write: 193.5 MiB/s
INFO: 22% (347.6 GiB of 1.5 TiB) in 31m 58s, read: 186.6 MiB/s, write: 186.6 MiB/s
INFO: 23% (363.4 GiB of 1.5 TiB) in 33m 51s, read: 143.4 MiB/s, write: 143.3 MiB/s
INFO: 24% (379.3 GiB of 1.5 TiB) in 35m 22s, read: 178.6 MiB/s, write: 178.6 MiB/s
INFO: 25% (395.2 GiB of 1.5 TiB) in 36m 53s, read: 178.4 MiB/s, write: 178.4 MiB/s
INFO: 26% (410.9 GiB of 1.5 TiB) in 38m 18s, read: 189.3 MiB/s, write: 189.3 MiB/s
INFO: 27% (426.8 GiB of 1.5 TiB) in 39m 45s, read: 186.9 MiB/s, write: 186.9 MiB/s
INFO: 28% (442.5 GiB of 1.5 TiB) in 41m 25s, read: 161.2 MiB/s, write: 160.8 MiB/s
INFO: 29% (458.4 GiB of 1.5 TiB) in 42m 51s, read: 188.9 MiB/s, write: 188.9 MiB/s
INFO: 30% (474.1 GiB of 1.5 TiB) in 44m 17s, read: 187.0 MiB/s, write: 187.0 MiB/s
INFO: 31% (489.9 GiB of 1.5 TiB) in 45m 53s, read: 168.9 MiB/s, write: 168.8 MiB/s
INFO: 32% (505.8 GiB of 1.5 TiB) in 47m 20s, read: 186.7 MiB/s, write: 186.7 MiB/s
INFO: 33% (521.5 GiB of 1.5 TiB) in 48m 54s, read: 171.6 MiB/s, write: 171.2 MiB/s
INFO: 34% (537.3 GiB of 1.5 TiB) in 50m 18s, read: 192.1 MiB/s, write: 192.1 MiB/s
INFO: 35% (553.1 GiB of 1.5 TiB) in 51m 54s, read: 169.1 MiB/s, write: 168.9 MiB/s
INFO: 36% (568.9 GiB of 1.5 TiB) in 53m 17s, read: 194.4 MiB/s, write: 194.4 MiB/s
INFO: 37% (584.7 GiB of 1.5 TiB) in 54m 51s, read: 172.7 MiB/s, write: 172.7 MiB/s
INFO: 38% (600.6 GiB of 1.5 TiB) in 56m 17s, read: 188.4 MiB/s, write: 188.4 MiB/s
INFO: 39% (616.4 GiB of 1.5 TiB) in 57m 43s, read: 188.0 MiB/s, write: 188.0 MiB/s
INFO: 40% (632.1 GiB of 1.5 TiB) in 59m 7s, read: 192.1 MiB/s, write: 192.1 MiB/s
INFO: 41% (647.9 GiB of 1.5 TiB) in 1h 40s, read: 174.3 MiB/s, write: 174.3 MiB/s
INFO: 42% (663.7 GiB of 1.5 TiB) in 1h 2m 5s, read: 189.4 MiB/s, write: 189.4 MiB/s
INFO: 43% (679.6 GiB of 1.5 TiB) in 1h 3m 38s, read: 174.9 MiB/s, write: 174.8 MiB/s
INFO: 44% (695.4 GiB of 1.5 TiB) in 1h 5m 12s, read: 172.2 MiB/s, write: 171.9 MiB/s
INFO: 45% (711.1 GiB of 1.5 TiB) in 1h 6m 48s, read: 168.3 MiB/s, write: 167.9 MiB/s
INFO: 46% (727.0 GiB of 1.5 TiB) in 1h 8m 37s, read: 148.8 MiB/s, write: 148.8 MiB/s
INFO: 47% (742.7 GiB of 1.5 TiB) in 1h 10m 13s, read: 168.1 MiB/s, write: 167.7 MiB/s
INFO: 48% (758.5 GiB of 1.5 TiB) in 1h 11m 36s, read: 193.9 MiB/s, write: 193.9 MiB/s
INFO: 49% (774.2 GiB of 1.5 TiB) in 1h 13m 17s, read: 159.9 MiB/s, write: 159.7 MiB/s
INFO: 50% (790.1 GiB of 1.5 TiB) in 1h 14m 42s, read: 191.0 MiB/s, write: 191.0 MiB/s
INFO: 51% (805.9 GiB of 1.5 TiB) in 1h 16m 18s, read: 168.4 MiB/s, write: 168.3 MiB/s
INFO: 52% (821.7 GiB of 1.5 TiB) in 1h 17m 43s, read: 190.2 MiB/s, write: 190.2 MiB/s
INFO: 53% (837.5 GiB of 1.5 TiB) in 1h 19m 21s, read: 165.6 MiB/s, write: 165.6 MiB/s
INFO: 54% (853.2 GiB of 1.5 TiB) in 1h 20m 47s, read: 187.3 MiB/s, write: 187.3 MiB/s
INFO: 55% (869.2 GiB of 1.5 TiB) in 1h 22m 23s, read: 169.7 MiB/s, write: 169.4 MiB/s
INFO: 56% (884.8 GiB of 1.5 TiB) in 1h 23m 58s, read: 169.0 MiB/s, write: 169.0 MiB/s
INFO: 57% (900.6 GiB of 1.5 TiB) in 1h 25m 33s, read: 170.3 MiB/s, write: 170.3 MiB/s
INFO: 58% (916.5 GiB of 1.5 TiB) in 1h 27m, read: 187.1 MiB/s, write: 186.8 MiB/s
INFO: 59% (932.4 GiB of 1.5 TiB) in 1h 28m 24s, read: 193.4 MiB/s, write: 193.4 MiB/s
INFO: 60% (948.2 GiB of 1.5 TiB) in 1h 29m 48s, read: 192.3 MiB/s, write: 192.3 MiB/s
INFO: 61% (963.9 GiB of 1.5 TiB) in 1h 31m 15s, read: 185.1 MiB/s, write: 184.9 MiB/s
INFO: 62% (979.6 GiB of 1.5 TiB) in 1h 32m 37s, read: 196.1 MiB/s, write: 196.1 MiB/s
INFO: 63% (995.4 GiB of 1.5 TiB) in 1h 34m 4s, read: 186.4 MiB/s, write: 186.4 MiB/s
INFO: 64% (1011.3 GiB of 1.5 TiB) in 1h 35m 28s, read: 193.1 MiB/s, write: 193.0 MiB/s
INFO: 65% (1.0 TiB of 1.5 TiB) in 1h 36m 50s, read: 197.1 MiB/s, write: 197.1 MiB/s
INFO: 66% (1.0 TiB of 1.5 TiB) in 1h 38m 16s, read: 189.0 MiB/s, write: 189.0 MiB/s
zstd: error 25 : Write error : File too large (cannot write compressed block)
INFO: 66% (1.0 TiB of 1.5 TiB) in 1h 39m 12s, read: 175.0 MiB/s, write: 174.3 MiB/s
ERROR: vma_queue_write: write error - Broken pipe
INFO: aborting backup job
INFO: resuming VM again
ERROR: Backup of VM 132 failed - vma_queue_write: write error - Broken pipe
INFO: Failed at 2021-12-27 01:39:17
INFO: Backup job finished with errors
TASK ERROR: job errors
i see error: ERROR: Backup of VM 132 failed - vma_queue_write: write error - Broken pipe
but before the error is: zstd: error 25 : Write error : File too large (cannot write compressed block)
the backup target is a CEPHFS external storage with 30TB available .
i check the /etc/vzdump.conf
but tmp folder is not "enable" that mean use the target storage as a tmp.
can help me to investigate and fix this issues? thanks,
i've a problem with backup. when the VM is largher then 1TB
INFO: starting new backup job: vzdump 132 --storage vm-backup --mailto mymail --mailnotification always --mode snapshot --compress zstd --quiet 1
INFO: Starting Backup of VM 132 (qemu)
INFO: Backup started at 2021-12-27 00:00:02
INFO: status = running
INFO: VM Name: mailstore9
INFO: include disk 'virtio0' 'CEPH_Local:vm-132-disk-0' 40G
INFO: include disk 'virtio1' 'CEPH_Local:vm-132-disk-1' 1540G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/vm-backup/dump/vzdump-qemu-132-2021_12_27-00_00_02.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '11ea62b7-d836-4beb-bb3f-506ecce3537a'
INFO: resuming VM again
INFO: 0% (764.9 MiB of 1.5 TiB) in 3s, read: 255.0 MiB/s, write: 234.2 MiB/s
INFO: 1% (15.9 GiB of 1.5 TiB) in 1m 22s, read: 196.4 MiB/s, write: 196.4 MiB/s
INFO: 2% (31.7 GiB of 1.5 TiB) in 2m 44s, read: 197.3 MiB/s, write: 197.3 MiB/s
INFO: 3% (47.5 GiB of 1.5 TiB) in 4m 7s, read: 194.5 MiB/s, write: 194.5 MiB/s
INFO: 4% (63.2 GiB of 1.5 TiB) in 5m 36s, read: 181.2 MiB/s, write: 181.2 MiB/s
INFO: 5% (79.1 GiB of 1.5 TiB) in 7m 4s, read: 185.0 MiB/s, write: 185.0 MiB/s
INFO: 6% (95.0 GiB of 1.5 TiB) in 8m 32s, read: 184.5 MiB/s, write: 184.5 MiB/s
INFO: 7% (110.7 GiB of 1.5 TiB) in 9m 58s, read: 187.1 MiB/s, write: 187.1 MiB/s
INFO: 8% (126.5 GiB of 1.5 TiB) in 12m 15s, read: 118.3 MiB/s, write: 118.3 MiB/s
INFO: 9% (142.3 GiB of 1.5 TiB) in 13m 44s, read: 181.5 MiB/s, write: 181.5 MiB/s
INFO: 10% (158.2 GiB of 1.5 TiB) in 15m 11s, read: 187.0 MiB/s, write: 187.0 MiB/s
INFO: 11% (173.9 GiB of 1.5 TiB) in 16m 34s, read: 194.3 MiB/s, write: 194.3 MiB/s
INFO: 12% (189.7 GiB of 1.5 TiB) in 17m 59s, read: 190.7 MiB/s, write: 190.7 MiB/s
INFO: 13% (205.5 GiB of 1.5 TiB) in 19m 22s, read: 194.5 MiB/s, write: 194.5 MiB/s
INFO: 14% (221.2 GiB of 1.5 TiB) in 20m 44s, read: 196.0 MiB/s, write: 196.0 MiB/s
INFO: 15% (237.1 GiB of 1.5 TiB) in 22m 8s, read: 194.1 MiB/s, write: 194.1 MiB/s
INFO: 16% (252.9 GiB of 1.5 TiB) in 23m 32s, read: 191.8 MiB/s, write: 191.8 MiB/s
INFO: 17% (268.6 GiB of 1.5 TiB) in 24m 56s, read: 192.4 MiB/s, write: 192.4 MiB/s
INFO: 18% (284.5 GiB of 1.5 TiB) in 26m 21s, read: 191.5 MiB/s, write: 191.5 MiB/s
INFO: 19% (300.3 GiB of 1.5 TiB) in 27m 45s, read: 191.6 MiB/s, write: 191.6 MiB/s
INFO: 20% (316.1 GiB of 1.5 TiB) in 29m 8s, read: 195.2 MiB/s, write: 195.2 MiB/s
INFO: 21% (331.9 GiB of 1.5 TiB) in 30m 32s, read: 193.5 MiB/s, write: 193.5 MiB/s
INFO: 22% (347.6 GiB of 1.5 TiB) in 31m 58s, read: 186.6 MiB/s, write: 186.6 MiB/s
INFO: 23% (363.4 GiB of 1.5 TiB) in 33m 51s, read: 143.4 MiB/s, write: 143.3 MiB/s
INFO: 24% (379.3 GiB of 1.5 TiB) in 35m 22s, read: 178.6 MiB/s, write: 178.6 MiB/s
INFO: 25% (395.2 GiB of 1.5 TiB) in 36m 53s, read: 178.4 MiB/s, write: 178.4 MiB/s
INFO: 26% (410.9 GiB of 1.5 TiB) in 38m 18s, read: 189.3 MiB/s, write: 189.3 MiB/s
INFO: 27% (426.8 GiB of 1.5 TiB) in 39m 45s, read: 186.9 MiB/s, write: 186.9 MiB/s
INFO: 28% (442.5 GiB of 1.5 TiB) in 41m 25s, read: 161.2 MiB/s, write: 160.8 MiB/s
INFO: 29% (458.4 GiB of 1.5 TiB) in 42m 51s, read: 188.9 MiB/s, write: 188.9 MiB/s
INFO: 30% (474.1 GiB of 1.5 TiB) in 44m 17s, read: 187.0 MiB/s, write: 187.0 MiB/s
INFO: 31% (489.9 GiB of 1.5 TiB) in 45m 53s, read: 168.9 MiB/s, write: 168.8 MiB/s
INFO: 32% (505.8 GiB of 1.5 TiB) in 47m 20s, read: 186.7 MiB/s, write: 186.7 MiB/s
INFO: 33% (521.5 GiB of 1.5 TiB) in 48m 54s, read: 171.6 MiB/s, write: 171.2 MiB/s
INFO: 34% (537.3 GiB of 1.5 TiB) in 50m 18s, read: 192.1 MiB/s, write: 192.1 MiB/s
INFO: 35% (553.1 GiB of 1.5 TiB) in 51m 54s, read: 169.1 MiB/s, write: 168.9 MiB/s
INFO: 36% (568.9 GiB of 1.5 TiB) in 53m 17s, read: 194.4 MiB/s, write: 194.4 MiB/s
INFO: 37% (584.7 GiB of 1.5 TiB) in 54m 51s, read: 172.7 MiB/s, write: 172.7 MiB/s
INFO: 38% (600.6 GiB of 1.5 TiB) in 56m 17s, read: 188.4 MiB/s, write: 188.4 MiB/s
INFO: 39% (616.4 GiB of 1.5 TiB) in 57m 43s, read: 188.0 MiB/s, write: 188.0 MiB/s
INFO: 40% (632.1 GiB of 1.5 TiB) in 59m 7s, read: 192.1 MiB/s, write: 192.1 MiB/s
INFO: 41% (647.9 GiB of 1.5 TiB) in 1h 40s, read: 174.3 MiB/s, write: 174.3 MiB/s
INFO: 42% (663.7 GiB of 1.5 TiB) in 1h 2m 5s, read: 189.4 MiB/s, write: 189.4 MiB/s
INFO: 43% (679.6 GiB of 1.5 TiB) in 1h 3m 38s, read: 174.9 MiB/s, write: 174.8 MiB/s
INFO: 44% (695.4 GiB of 1.5 TiB) in 1h 5m 12s, read: 172.2 MiB/s, write: 171.9 MiB/s
INFO: 45% (711.1 GiB of 1.5 TiB) in 1h 6m 48s, read: 168.3 MiB/s, write: 167.9 MiB/s
INFO: 46% (727.0 GiB of 1.5 TiB) in 1h 8m 37s, read: 148.8 MiB/s, write: 148.8 MiB/s
INFO: 47% (742.7 GiB of 1.5 TiB) in 1h 10m 13s, read: 168.1 MiB/s, write: 167.7 MiB/s
INFO: 48% (758.5 GiB of 1.5 TiB) in 1h 11m 36s, read: 193.9 MiB/s, write: 193.9 MiB/s
INFO: 49% (774.2 GiB of 1.5 TiB) in 1h 13m 17s, read: 159.9 MiB/s, write: 159.7 MiB/s
INFO: 50% (790.1 GiB of 1.5 TiB) in 1h 14m 42s, read: 191.0 MiB/s, write: 191.0 MiB/s
INFO: 51% (805.9 GiB of 1.5 TiB) in 1h 16m 18s, read: 168.4 MiB/s, write: 168.3 MiB/s
INFO: 52% (821.7 GiB of 1.5 TiB) in 1h 17m 43s, read: 190.2 MiB/s, write: 190.2 MiB/s
INFO: 53% (837.5 GiB of 1.5 TiB) in 1h 19m 21s, read: 165.6 MiB/s, write: 165.6 MiB/s
INFO: 54% (853.2 GiB of 1.5 TiB) in 1h 20m 47s, read: 187.3 MiB/s, write: 187.3 MiB/s
INFO: 55% (869.2 GiB of 1.5 TiB) in 1h 22m 23s, read: 169.7 MiB/s, write: 169.4 MiB/s
INFO: 56% (884.8 GiB of 1.5 TiB) in 1h 23m 58s, read: 169.0 MiB/s, write: 169.0 MiB/s
INFO: 57% (900.6 GiB of 1.5 TiB) in 1h 25m 33s, read: 170.3 MiB/s, write: 170.3 MiB/s
INFO: 58% (916.5 GiB of 1.5 TiB) in 1h 27m, read: 187.1 MiB/s, write: 186.8 MiB/s
INFO: 59% (932.4 GiB of 1.5 TiB) in 1h 28m 24s, read: 193.4 MiB/s, write: 193.4 MiB/s
INFO: 60% (948.2 GiB of 1.5 TiB) in 1h 29m 48s, read: 192.3 MiB/s, write: 192.3 MiB/s
INFO: 61% (963.9 GiB of 1.5 TiB) in 1h 31m 15s, read: 185.1 MiB/s, write: 184.9 MiB/s
INFO: 62% (979.6 GiB of 1.5 TiB) in 1h 32m 37s, read: 196.1 MiB/s, write: 196.1 MiB/s
INFO: 63% (995.4 GiB of 1.5 TiB) in 1h 34m 4s, read: 186.4 MiB/s, write: 186.4 MiB/s
INFO: 64% (1011.3 GiB of 1.5 TiB) in 1h 35m 28s, read: 193.1 MiB/s, write: 193.0 MiB/s
INFO: 65% (1.0 TiB of 1.5 TiB) in 1h 36m 50s, read: 197.1 MiB/s, write: 197.1 MiB/s
INFO: 66% (1.0 TiB of 1.5 TiB) in 1h 38m 16s, read: 189.0 MiB/s, write: 189.0 MiB/s
zstd: error 25 : Write error : File too large (cannot write compressed block)
INFO: 66% (1.0 TiB of 1.5 TiB) in 1h 39m 12s, read: 175.0 MiB/s, write: 174.3 MiB/s
ERROR: vma_queue_write: write error - Broken pipe
INFO: aborting backup job
INFO: resuming VM again
ERROR: Backup of VM 132 failed - vma_queue_write: write error - Broken pipe
INFO: Failed at 2021-12-27 01:39:17
INFO: Backup job finished with errors
TASK ERROR: job errors
i see error: ERROR: Backup of VM 132 failed - vma_queue_write: write error - Broken pipe
but before the error is: zstd: error 25 : Write error : File too large (cannot write compressed block)
the backup target is a CEPHFS external storage with 30TB available .
i check the /etc/vzdump.conf
but tmp folder is not "enable" that mean use the target storage as a tmp.
can help me to investigate and fix this issues? thanks,
