Backup failed with gzip wrong exit code 1

P

Pongtawat

Active Member
Mar 16, 2017
5
1
43
Hello,

Some of my schedule backup failed with the error:

gzip --rsyncable failed - wrong exit status 1

Although backup progress in the log finished at 100%, the backup still failed with gzip (or zstd) wrong exit status.
This happen with both CT and VM backup, and with gzip and zstd comprerssion.
Strangely, some backups finished fine, but most failed.

My setup is Proxmox VE 6.3 on 2-node cluster using ZFS RAID. Backup storage is on a remote CIFS share which was added via Proxmox GUI. The CIFS server is on another data center/provider.

Is backup storage on CIFS unsupported? Or what was I doing wrong?

Thank you,
Pongtawat

Sample backup log follows:

vzdump --mailnotification always --compress gzip --mailto sysadmin@XXX --storage backup-migrate --quiet 1 --pool testing-backup --mode snapshot


623: 2021-03-04 01:00:03 INFO: Starting Backup of VM 623 (lxc)
623: 2021-03-04 01:00:03 INFO: status = running
623: 2021-03-04 01:00:03 INFO: CT Name: XXX
623: 2021-03-04 01:00:03 INFO: including mount point rootfs ('/') in backup
623: 2021-03-04 01:00:03 INFO: backup mode: snapshot
623: 2021-03-04 01:00:03 INFO: ionice priority: 7
623: 2021-03-04 01:00:03 INFO: create storage snapshot 'vzdump'
623: 2021-03-04 01:00:03 INFO: creating vzdump archive '/mnt/pve/backup-migrate/dump/vzdump-lxc-623-2021_03_04-01_00_03.tar.gz'
623: 2021-03-04 01:00:48 INFO: Total bytes written: 1006684160 (961MiB, 22MiB/s)
623: 2021-03-04 01:00:50 INFO: archive file size: 346MB
623: 2021-03-04 01:00:50 INFO: cleanup temporary 'vzdump' snapshot
623: 2021-03-04 01:00:50 INFO: Finished Backup of VM 623 (00:00:47)

627: 2021-03-04 01:00:50 INFO: Starting Backup of VM 627 (qemu)
627: 2021-03-04 01:00:50 INFO: status = running
627: 2021-03-04 01:00:50 INFO: VM Name: XXX
627: 2021-03-04 01:00:50 INFO: include disk 'scsi0' 'testing:vm-627-disk-0' 35G
627: 2021-03-04 01:00:50 INFO: backup mode: snapshot
627: 2021-03-04 01:00:50 INFO: ionice priority: 7
627: 2021-03-04 01:00:51 INFO: creating vzdump archive '/mnt/pve/backup-migrate/dump/vzdump-qemu-627-2021_03_04-01_00_50.vma.gz'
627: 2021-03-04 01:00:51 INFO: started backup task '6dadd1c5-1a8a-4e55-a81d-56b9bedacd94'
627: 2021-03-04 01:00:51 INFO: resuming VM again
627: 2021-03-04 01:00:54 INFO: 0% (199.4 MiB of 35.0 GiB) in 3s, read: 66.5 MiB/s, write: 22.7 MiB/s
627: 2021-03-04 01:01:02 INFO: 1% (377.0 MiB of 35.0 GiB) in 11s, read: 22.2 MiB/s, write: 22.1 MiB/s
627: 2021-03-04 01:01:16 INFO: 2% (728.6 MiB of 35.0 GiB) in 25s, read: 25.1 MiB/s, write: 22.8 MiB/s
627: 2021-03-04 01:01:22 INFO: 3% (1.1 GiB of 35.0 GiB) in 31s, read: 66.4 MiB/s, write: 31.7 MiB/s
627: 2021-03-04 01:01:32 INFO: 4% (1.4 GiB of 35.0 GiB) in 41s, read: 31.2 MiB/s, write: 30.8 MiB/s
627: 2021-03-04 01:01:44 INFO: 5% (1.8 GiB of 35.0 GiB) in 53s, read: 31.1 MiB/s, write: 30.9 MiB/s
627: 2021-03-04 01:01:56 INFO: 6% (2.1 GiB of 35.0 GiB) in 1m 5s, read: 30.2 MiB/s, write: 29.9 MiB/s
627: 2021-03-04 01:02:07 INFO: 7% (2.5 GiB of 35.0 GiB) in 1m 16s, read: 32.0 MiB/s, write: 27.9 MiB/s
627: 2021-03-04 01:02:19 INFO: 8% (2.8 GiB of 35.0 GiB) in 1m 28s, read: 30.2 MiB/s, write: 28.7 MiB/s
627: 2021-03-04 01:02:28 INFO: 9% (3.2 GiB of 35.0 GiB) in 1m 37s, read: 39.1 MiB/s, write: 38.0 MiB/s
627: 2021-03-04 01:02:40 INFO: 10% (3.5 GiB of 35.0 GiB) in 1m 49s, read: 30.8 MiB/s, write: 30.7 MiB/s
627: 2021-03-04 01:02:52 INFO: 11% (3.9 GiB of 35.0 GiB) in 2m 1s, read: 28.7 MiB/s, write: 28.5 MiB/s
627: 2021-03-04 01:03:05 INFO: 12% (4.2 GiB of 35.0 GiB) in 2m 14s, read: 28.2 MiB/s, write: 26.6 MiB/s
627: 2021-03-04 01:03:16 INFO: 13% (4.6 GiB of 35.0 GiB) in 2m 25s, read: 32.6 MiB/s, write: 27.0 MiB/s
627: 2021-03-04 01:03:28 INFO: 14% (4.9 GiB of 35.0 GiB) in 2m 37s, read: 28.7 MiB/s, write: 28.4 MiB/s
627: 2021-03-04 01:03:41 INFO: 15% (5.3 GiB of 35.0 GiB) in 2m 50s, read: 28.7 MiB/s, write: 27.6 MiB/s
627: 2021-03-04 01:03:56 INFO: 16% (5.6 GiB of 35.0 GiB) in 3m 5s, read: 22.7 MiB/s, write: 21.2 MiB/s
627: 2021-03-04 01:04:12 INFO: 17% (6.0 GiB of 35.0 GiB) in 3m 21s, read: 23.6 MiB/s, write: 22.9 MiB/s
627: 2021-03-04 01:04:24 INFO: 18% (6.3 GiB of 35.0 GiB) in 3m 33s, read: 28.1 MiB/s, write: 26.8 MiB/s
627: 2021-03-04 01:04:41 INFO: 19% (6.7 GiB of 35.0 GiB) in 3m 50s, read: 22.4 MiB/s, write: 21.6 MiB/s
627: 2021-03-04 01:04:57 INFO: 20% (7.0 GiB of 35.0 GiB) in 4m 6s, read: 23.1 MiB/s, write: 23.0 MiB/s
627: 2021-03-04 01:05:09 INFO: 21% (7.4 GiB of 35.0 GiB) in 4m 18s, read: 28.1 MiB/s, write: 27.8 MiB/s
627: 2021-03-04 01:05:22 INFO: 22% (7.7 GiB of 35.0 GiB) in 4m 31s, read: 27.0 MiB/s, write: 26.0 MiB/s
627: 2021-03-04 01:05:34 INFO: 23% (8.1 GiB of 35.0 GiB) in 4m 43s, read: 30.2 MiB/s, write: 29.9 MiB/s
627: 2021-03-04 01:05:48 INFO: 24% (8.4 GiB of 35.0 GiB) in 4m 57s, read: 24.9 MiB/s, write: 24.8 MiB/s
627: 2021-03-04 01:06:03 INFO: 25% (8.8 GiB of 35.0 GiB) in 5m 12s, read: 24.2 MiB/s, write: 23.1 MiB/s
627: 2021-03-04 01:06:18 INFO: 26% (9.1 GiB of 35.0 GiB) in 5m 27s, read: 23.9 MiB/s, write: 23.9 MiB/s
627: 2021-03-04 01:06:31 INFO: 27% (9.5 GiB of 35.0 GiB) in 5m 40s, read: 29.4 MiB/s, write: 29.3 MiB/s
627: 2021-03-04 01:06:43 INFO: 28% (9.8 GiB of 35.0 GiB) in 5m 52s, read: 28.3 MiB/s, write: 28.1 MiB/s
627: 2021-03-04 01:06:58 INFO: 29% (10.2 GiB of 35.0 GiB) in 6m 7s, read: 23.7 MiB/s, write: 23.1 MiB/s
627: 2021-03-04 01:07:13 INFO: 30% (10.5 GiB of 35.0 GiB) in 6m 22s, read: 24.6 MiB/s, write: 24.5 MiB/s
627: 2021-03-04 01:07:28 INFO: 31% (10.9 GiB of 35.0 GiB) in 6m 37s, read: 23.4 MiB/s, write: 23.1 MiB/s
627: 2021-03-04 01:07:42 INFO: 32% (11.3 GiB of 35.0 GiB) in 6m 51s, read: 31.1 MiB/s, write: 25.9 MiB/s
627: 2021-03-04 01:07:49 INFO: 33% (11.6 GiB of 35.0 GiB) in 6m 58s, read: 48.0 MiB/s, write: 35.4 MiB/s
627: 2021-03-04 01:07:58 INFO: 34% (11.9 GiB of 35.0 GiB) in 7m 7s, read: 33.2 MiB/s, write: 32.4 MiB/s
627: 2021-03-04 01:08:09 INFO: 35% (12.3 GiB of 35.0 GiB) in 7m 18s, read: 33.6 MiB/s, write: 32.6 MiB/s
627: 2021-03-04 01:08:21 INFO: 36% (12.6 GiB of 35.0 GiB) in 7m 30s, read: 29.9 MiB/s, write: 29.5 MiB/s
627: 2021-03-04 01:08:36 INFO: 37% (13.0 GiB of 35.0 GiB) in 7m 45s, read: 23.5 MiB/s, write: 23.4 MiB/s
627: 2021-03-04 01:08:49 INFO: 38% (13.3 GiB of 35.0 GiB) in 7m 58s, read: 27.1 MiB/s, write: 26.8 MiB/s
627: 2021-03-04 01:09:04 INFO: 39% (13.7 GiB of 35.0 GiB) in 8m 13s, read: 24.9 MiB/s, write: 24.6 MiB/s
627: 2021-03-04 01:09:20 INFO: 40% (14.0 GiB of 35.0 GiB) in 8m 29s, read: 22.4 MiB/s, write: 22.4 MiB/s
627: 2021-03-04 01:09:35 INFO: 41% (14.4 GiB of 35.0 GiB) in 8m 44s, read: 24.4 MiB/s, write: 22.9 MiB/s
627: 2021-03-04 01:09:49 INFO: 42% (14.7 GiB of 35.0 GiB) in 8m 58s, read: 24.3 MiB/s, write: 24.1 MiB/s
627: 2021-03-04 01:10:03 INFO: 43% (15.1 GiB of 35.0 GiB) in 9m 12s, read: 25.4 MiB/s, write: 25.3 MiB/s
627: 2021-03-04 01:10:14 INFO: 44% (15.4 GiB of 35.0 GiB) in 9m 23s, read: 32.6 MiB/s, write: 30.4 MiB/s
627: 2021-03-04 01:10:28 INFO: 45% (15.8 GiB of 35.0 GiB) in 9m 37s, read: 26.9 MiB/s, write: 26.9 MiB/s
627: 2021-03-04 01:10:42 INFO: 46% (16.1 GiB of 35.0 GiB) in 9m 51s, read: 24.6 MiB/s, write: 24.6 MiB/s
627: 2021-03-04 01:10:55 INFO: 47% (16.5 GiB of 35.0 GiB) in 10m 4s, read: 27.9 MiB/s, write: 27.8 MiB/s
627: 2021-03-04 01:11:09 INFO: 48% (16.8 GiB of 35.0 GiB) in 10m 18s, read: 25.9 MiB/s, write: 25.7 MiB/s
627: 2021-03-04 01:11:22 INFO: 49% (17.2 GiB of 35.0 GiB) in 10m 31s, read: 27.6 MiB/s, write: 27.6 MiB/s
627: 2021-03-04 01:11:37 INFO: 50% (17.5 GiB of 35.0 GiB) in 10m 46s, read: 23.9 MiB/s, write: 23.9 MiB/s
627: 2021-03-04 01:11:50 INFO: 51% (17.9 GiB of 35.0 GiB) in 10m 59s, read: 28.2 MiB/s, write: 28.2 MiB/s
627: 2021-03-04 01:12:05 INFO: 52% (18.2 GiB of 35.0 GiB) in 11m 14s, read: 23.7 MiB/s, write: 23.4 MiB/s
627: 2021-03-04 01:12:23 INFO: 53% (18.6 GiB of 35.0 GiB) in 11m 32s, read: 18.9 MiB/s, write: 18.9 MiB/s
627: 2021-03-04 01:12:39 INFO: 54% (18.9 GiB of 35.0 GiB) in 11m 48s, read: 23.8 MiB/s, write: 23.7 MiB/s
627: 2021-03-04 01:12:50 INFO: 55% (19.3 GiB of 35.0 GiB) in 11m 59s, read: 30.0 MiB/s, write: 30.0 MiB/s
627: 2021-03-04 01:13:08 INFO: 56% (19.6 GiB of 35.0 GiB) in 12m 17s, read: 21.3 MiB/s, write: 21.2 MiB/s
627: 2021-03-04 01:13:21 INFO: 57% (20.0 GiB of 35.0 GiB) in 12m 30s, read: 27.9 MiB/s, write: 27.8 MiB/s
627: 2021-03-04 01:13:36 INFO: 58% (20.3 GiB of 35.0 GiB) in 12m 45s, read: 23.0 MiB/s, write: 22.9 MiB/s
627: 2021-03-04 01:13:52 INFO: 59% (20.7 GiB of 35.0 GiB) in 13m 1s, read: 22.2 MiB/s, write: 22.2 MiB/s
627: 2021-03-04 01:14:05 INFO: 60% (21.0 GiB of 35.0 GiB) in 13m 14s, read: 27.9 MiB/s, write: 27.9 MiB/s
627: 2021-03-04 01:14:18 INFO: 61% (21.4 GiB of 35.0 GiB) in 13m 27s, read: 27.0 MiB/s, write: 26.3 MiB/s
627: 2021-03-04 01:14:35 INFO: 62% (21.7 GiB of 35.0 GiB) in 13m 44s, read: 22.0 MiB/s, write: 22.0 MiB/s
627: 2021-03-04 01:14:50 INFO: 63% (22.1 GiB of 35.0 GiB) in 13m 59s, read: 23.0 MiB/s, write: 22.7 MiB/s
627: 2021-03-04 01:15:06 INFO: 64% (22.4 GiB of 35.0 GiB) in 14m 15s, read: 21.8 MiB/s, write: 20.4 MiB/s
627: 2021-03-04 01:15:23 INFO: 65% (22.8 GiB of 35.0 GiB) in 14m 32s, read: 22.4 MiB/s, write: 22.4 MiB/s
627: 2021-03-04 01:15:34 INFO: 66% (23.1 GiB of 35.0 GiB) in 14m 43s, read: 31.6 MiB/s, write: 25.3 MiB/s
627: 2021-03-04 01:15:48 INFO: 67% (23.5 GiB of 35.0 GiB) in 14m 57s, read: 25.6 MiB/s, write: 23.8 MiB/s
627: 2021-03-04 01:15:59 INFO: 68% (23.8 GiB of 35.0 GiB) in 15m 8s, read: 33.9 MiB/s, write: 21.5 MiB/s
627: 2021-03-04 01:16:10 INFO: 69% (24.2 GiB of 35.0 GiB) in 15m 19s, read: 30.3 MiB/s, write: 28.8 MiB/s
627: 2021-03-04 01:16:24 INFO: 70% (24.5 GiB of 35.0 GiB) in 15m 33s, read: 26.7 MiB/s, write: 25.4 MiB/s
627: 2021-03-04 01:16:31 INFO: 71% (24.9 GiB of 35.0 GiB) in 15m 40s, read: 52.8 MiB/s, write: 25.9 MiB/s
627: 2021-03-04 01:16:39 INFO: 72% (25.2 GiB of 35.0 GiB) in 15m 48s, read: 41.2 MiB/s, write: 31.0 MiB/s
627: 2021-03-04 01:16:54 INFO: 73% (25.6 GiB of 35.0 GiB) in 16m 3s, read: 24.6 MiB/s, write: 24.4 MiB/s
627: 2021-03-04 01:17:10 INFO: 74% (25.9 GiB of 35.0 GiB) in 16m 19s, read: 22.9 MiB/s, write: 22.4 MiB/s
627: 2021-03-04 01:17:24 INFO: 75% (26.3 GiB of 35.0 GiB) in 16m 33s, read: 24.6 MiB/s, write: 23.6 MiB/s
627: 2021-03-04 01:17:38 INFO: 76% (26.6 GiB of 35.0 GiB) in 16m 47s, read: 26.0 MiB/s, write: 25.6 MiB/s
627: 2021-03-04 01:17:54 INFO: 77% (27.0 GiB of 35.0 GiB) in 17m 3s, read: 22.1 MiB/s, write: 22.1 MiB/s
627: 2021-03-04 01:18:08 INFO: 78% (27.3 GiB of 35.0 GiB) in 17m 17s, read: 25.1 MiB/s, write: 23.2 MiB/s
627: 2021-03-04 01:18:23 INFO: 79% (27.7 GiB of 35.0 GiB) in 17m 32s, read: 24.4 MiB/s, write: 24.3 MiB/s
627: 2021-03-04 01:18:38 INFO: 80% (28.0 GiB of 35.0 GiB) in 17m 47s, read: 24.4 MiB/s, write: 24.3 MiB/s
627: 2021-03-04 01:18:52 INFO: 81% (28.4 GiB of 35.0 GiB) in 18m 1s, read: 25.4 MiB/s, write: 23.4 MiB/s
627: 2021-03-04 01:19:06 INFO: 82% (28.7 GiB of 35.0 GiB) in 18m 15s, read: 25.9 MiB/s, write: 25.4 MiB/s
627: 2021-03-04 01:19:19 INFO: 83% (29.1 GiB of 35.0 GiB) in 18m 28s, read: 29.6 MiB/s, write: 27.2 MiB/s
627: 2021-03-04 01:19:34 INFO: 84% (29.4 GiB of 35.0 GiB) in 18m 43s, read: 22.0 MiB/s, write: 21.8 MiB/s
627: 2021-03-04 01:19:47 INFO: 85% (29.8 GiB of 35.0 GiB) in 18m 56s, read: 27.3 MiB/s, write: 27.2 MiB/s
627: 2021-03-04 01:20:04 INFO: 86% (30.1 GiB of 35.0 GiB) in 19m 13s, read: 21.1 MiB/s, write: 21.1 MiB/s
627: 2021-03-04 01:20:19 INFO: 87% (30.5 GiB of 35.0 GiB) in 19m 28s, read: 23.7 MiB/s, write: 22.2 MiB/s
627: 2021-03-04 01:20:36 INFO: 88% (30.8 GiB of 35.0 GiB) in 19m 45s, read: 21.3 MiB/s, write: 21.1 MiB/s
627: 2021-03-04 01:20:50 INFO: 89% (31.2 GiB of 35.0 GiB) in 19m 59s, read: 24.9 MiB/s, write: 23.4 MiB/s
627: 2021-03-04 01:21:07 INFO: 90% (31.5 GiB of 35.0 GiB) in 20m 16s, read: 22.4 MiB/s, write: 21.7 MiB/s
627: 2021-03-04 01:21:25 INFO: 91% (31.9 GiB of 35.0 GiB) in 20m 34s, read: 18.7 MiB/s, write: 18.2 MiB/s
627: 2021-03-04 01:21:42 INFO: 92% (32.2 GiB of 35.0 GiB) in 20m 51s, read: 21.1 MiB/s, write: 20.9 MiB/s
627: 2021-03-04 01:22:00 INFO: 93% (32.6 GiB of 35.0 GiB) in 21m 9s, read: 20.7 MiB/s, write: 20.4 MiB/s
627: 2021-03-04 01:22:16 INFO: 94% (32.9 GiB of 35.0 GiB) in 21m 25s, read: 21.8 MiB/s, write: 21.2 MiB/s
627: 2021-03-04 01:22:28 INFO: 95% (33.3 GiB of 35.0 GiB) in 21m 37s, read: 29.3 MiB/s, write: 26.5 MiB/s
627: 2021-03-04 01:22:46 INFO: 96% (33.6 GiB of 35.0 GiB) in 21m 55s, read: 20.7 MiB/s, write: 20.7 MiB/s
627: 2021-03-04 01:23:03 INFO: 97% (34.0 GiB of 35.0 GiB) in 22m 12s, read: 21.1 MiB/s, write: 21.0 MiB/s
627: 2021-03-04 01:23:23 INFO: 98% (34.3 GiB of 35.0 GiB) in 22m 32s, read: 18.3 MiB/s, write: 18.3 MiB/s
627: 2021-03-04 01:23:35 INFO: 99% (34.7 GiB of 35.0 GiB) in 22m 44s, read: 28.4 MiB/s, write: 27.4 MiB/s
627: 2021-03-04 01:23:48 INFO: 100% (35.0 GiB of 35.0 GiB) in 22m 57s, read: 27.0 MiB/s, write: 24.0 MiB/s
627: 2021-03-04 01:23:48 INFO: backup is sparse: 1.78 GiB (5%) total zero data
627: 2021-03-04 01:23:48 INFO: transferred 35.00 GiB in 1377 seconds (26.0 MiB/s)
627: 2021-03-04 01:24:00 ERROR: Backup of VM 627 failed - gzip --rsyncable failed - wrong exit status 1
 
Last edited:
Another sample of failed CT backup:

vzdump --mailto sysadmin@XXX --compress gzip --mailnotification always --mode snapshot --pool production --storage backup-migrate --quiet 1


608: 2021-03-04 00:15:03 INFO: Starting Backup of VM 608 (lxc)
608: 2021-03-04 00:15:03 INFO: status = running
608: 2021-03-04 00:15:03 INFO: CT Name: XXX
608: 2021-03-04 00:15:03 INFO: including mount point rootfs ('/') in backup
608: 2021-03-04 00:15:03 INFO: backup mode: snapshot
608: 2021-03-04 00:15:03 INFO: ionice priority: 7
608: 2021-03-04 00:15:03 INFO: create storage snapshot 'vzdump'
608: 2021-03-04 00:15:03 INFO: creating vzdump archive '/mnt/pve/backup-migrate/dump/vzdump-lxc-608-2021_03_04-00_15_03.tar.gz'
608: 2021-03-04 00:16:58 INFO: Total bytes written: 2524047360 (2.4GiB, 21MiB/s)
608: 2021-03-04 00:17:01 INFO: gzip: stdout: Input/output error
608: 2021-03-04 00:17:01 INFO: cleanup temporary 'vzdump' snapshot
608: 2021-03-04 00:17:02 ERROR: Backup of VM 608 failed - command 'set -o pipefail && tar cpf - --totals --one-file-system -p --sparse --numeric-owner --acls --xattrs '--xattrs-include=user.*' '--xattrs-include=security.capability' '--warning=no-file-ignored' '--warning=no-xattr-write' --one-file-system '--warning=no-file-ignored' '--directory=/var/tmp/vzdumptmp26785_608' ./etc/vzdump/pct.conf ./etc/vzdump/pct.fw '--directory=/mnt/vzsnap0' --no-anchored '--exclude=lost+found' --anchored '--exclude=./tmp/?*' '--exclude=./var/tmp/?*' '--exclude=./var/run/?*.pid' ./ | gzip --rsyncable >/mnt/pve/backup-migrate/dump/vzdump-lxc-608-2021_03_04-00_15_03.tar.dat' failed: exit code 1
 
Code: 
608: 2021-03-04 00:17:01 INFO: gzip: stdout: Input/output error

sounds like a storage problem..
 
fabian said:
Code: 
608: 2021-03-04 00:17:01 INFO: gzip: stdout: Input/output error

sounds like a storage problem..
Click to expand...

You are right. After testing with rsync I get the same problem. Seem like my CIFS is unstable with large file.

Thank you,
Pongtawat
 
  • Like
Reactions: fabian
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back