Pbs not compressing storage

M

mgiammarco

Renowned Member
Feb 18, 2010
165
10
83
Hello,
I have a PBS 1.0-11 with 1.5 tb of space. I am backupping three VMs with disks 800 800 and 500. Disks are almost empty if I do backups with zstd I get vma.gz of 390, 270, 59 gb. Now I use PBS and I fill 1.5gtb without backupping the third VM. It seems compression is not applied but I have specified in the backup job.
What can I do?
Thanks,
Mario
 
how do you determine that it fills that much?
empty blocks really do not take up space

what does df -h say?
can you post the task logs of the backups?
 
I suppose this log wiil reply to all your questions:
Code: 
INFO: starting new backup job: vzdump 103 --remove 0 --node siippve1 --storage pbs --mode suspend
INFO: Starting Backup of VM 103 (qemu)
INFO: Backup started at 2021-04-05 23:24:47
INFO: status = running
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: VM Name: FreeNAS
INFO: suspending guest
INFO: skip unused drive 'rbd:vm-103-disk-2' (not included into backup)
INFO: skip unused drive 'ssd:vm-103-disk-0' (not included into backup)
INFO: skip unused drive 'ssd:vm-103-disk-1' (not included into backup)
INFO: creating Proxmox Backup Server archive 'vm/103/2021-04-05T21:24:47Z'
INFO: started backup task '31e75f2f-33dc-4d6f-af76-0d84554e4a96'
INFO: resuming VM again after 2 seconds
INFO: scsi0: dirty-bitmap status: existing bitmap was invalid and has been cleared
INFO: scsi1: dirty-bitmap status: existing bitmap was invalid and has been cleared
INFO:   0% (68.0 MiB of 810.0 GiB) in 3s, read: 22.7 MiB/s, write: 22.7 MiB/s
INFO:   1% (8.1 GiB of 810.0 GiB) in 6m 18s, read: 22.0 MiB/s, write: 21.4 MiB/s
INFO:   2% (16.2 GiB of 810.0 GiB) in 10m 15s, read: 35.0 MiB/s, write: 29.4 MiB/s
INFO:   3% (24.3 GiB of 810.0 GiB) in 17m 3s, read: 20.3 MiB/s, write: 20.2 MiB/s
INFO:   4% (32.4 GiB of 810.0 GiB) in 23m 53s, read: 20.3 MiB/s, write: 20.3 MiB/s
INFO:   5% (40.5 GiB of 810.0 GiB) in 29m 28s, read: 24.8 MiB/s, write: 24.8 MiB/s
INFO:   6% (48.6 GiB of 810.0 GiB) in 37m, read: 18.3 MiB/s, write: 18.2 MiB/s
INFO:   7% (56.7 GiB of 810.0 GiB) in 50m 13s, read: 10.5 MiB/s, write: 10.5 MiB/s
INFO:   8% (64.8 GiB of 810.0 GiB) in 1h 3m 26s, read: 10.5 MiB/s, write: 10.5 MiB/s
INFO:   9% (72.9 GiB of 810.0 GiB) in 1h 14m 26s, read: 12.6 MiB/s, write: 12.6 MiB/s
INFO:  10% (81.0 GiB of 810.0 GiB) in 1h 24m 26s, read: 13.8 MiB/s, write: 13.8 MiB/s
INFO:  11% (89.1 GiB of 810.0 GiB) in 1h 33m 55s, read: 14.6 MiB/s, write: 14.6 MiB/s
INFO:  12% (97.2 GiB of 810.0 GiB) in 1h 42m 2s, read: 17.0 MiB/s, write: 17.0 MiB/s
INFO:  13% (105.3 GiB of 810.0 GiB) in 1h 50m 12s, read: 16.9 MiB/s, write: 16.9 MiB/s
INFO:  14% (113.4 GiB of 810.0 GiB) in 1h 56m 8s, read: 23.3 MiB/s, write: 23.3 MiB/s
INFO:  15% (121.5 GiB of 810.0 GiB) in 2h 2m 55s, read: 20.4 MiB/s, write: 20.4 MiB/s
INFO:  16% (129.6 GiB of 810.0 GiB) in 2h 12m 11s, read: 14.9 MiB/s, write: 14.9 MiB/s
INFO:  17% (137.7 GiB of 810.0 GiB) in 2h 18m 39s, read: 21.4 MiB/s, write: 21.4 MiB/s
INFO:  18% (145.8 GiB of 810.0 GiB) in 2h 26m 57s, read: 16.6 MiB/s, write: 16.6 MiB/s
INFO:  19% (153.9 GiB of 810.0 GiB) in 2h 35m 44s, read: 15.7 MiB/s, write: 15.7 MiB/s
INFO:  20% (162.0 GiB of 810.0 GiB) in 2h 45m 59s, read: 13.5 MiB/s, write: 13.5 MiB/s
INFO:  21% (170.1 GiB of 810.0 GiB) in 2h 53m 28s, read: 18.5 MiB/s, write: 18.5 MiB/s
INFO:  22% (178.2 GiB of 810.0 GiB) in 3h 42s, read: 19.2 MiB/s, write: 19.2 MiB/s
INFO:  23% (186.3 GiB of 810.0 GiB) in 3h 7m 5s, read: 21.6 MiB/s, write: 21.6 MiB/s
INFO:  24% (194.4 GiB of 810.0 GiB) in 3h 16m 30s, read: 14.7 MiB/s, write: 14.7 MiB/s
INFO:  25% (202.5 GiB of 810.0 GiB) in 3h 23m 3s, read: 21.1 MiB/s, write: 21.1 MiB/s
INFO:  26% (210.6 GiB of 810.0 GiB) in 3h 30m 24s, read: 18.8 MiB/s, write: 18.8 MiB/s
INFO:  27% (218.7 GiB of 810.0 GiB) in 3h 36m 34s, read: 22.5 MiB/s, write: 22.5 MiB/s
INFO:  28% (226.8 GiB of 810.0 GiB) in 3h 44m 15s, read: 18.0 MiB/s, write: 17.9 MiB/s
INFO:  29% (234.9 GiB of 810.0 GiB) in 3h 54m 29s, read: 13.5 MiB/s, write: 13.5 MiB/s
INFO:  30% (243.0 GiB of 810.0 GiB) in 3h 59m 28s, read: 27.7 MiB/s, write: 27.7 MiB/s
INFO:  31% (251.1 GiB of 810.0 GiB) in 4h 8m 36s, read: 15.1 MiB/s, write: 15.1 MiB/s
INFO:  32% (259.2 GiB of 810.0 GiB) in 4h 16m 39s, read: 17.2 MiB/s, write: 17.2 MiB/s
INFO:  33% (267.3 GiB of 810.0 GiB) in 4h 21m 8s, read: 30.8 MiB/s, write: 30.8 MiB/s
INFO:  34% (275.4 GiB of 810.0 GiB) in 4h 26m 8s, read: 27.7 MiB/s, write: 27.7 MiB/s
INFO:  35% (283.5 GiB of 810.0 GiB) in 4h 34m 25s, read: 16.7 MiB/s, write: 16.7 MiB/s
INFO:  36% (291.6 GiB of 810.0 GiB) in 4h 41m 30s, read: 19.5 MiB/s, write: 19.5 MiB/s
INFO:  37% (299.7 GiB of 810.0 GiB) in 4h 47m 30s, read: 23.1 MiB/s, write: 22.8 MiB/s
INFO:  38% (307.8 GiB of 810.0 GiB) in 4h 52m 26s, read: 27.9 MiB/s, write: 27.9 MiB/s
INFO:  39% (315.9 GiB of 810.0 GiB) in 4h 57m 49s, read: 25.7 MiB/s, write: 25.7 MiB/s
INFO:  40% (324.0 GiB of 810.0 GiB) in 5h 6m 20s, read: 16.2 MiB/s, write: 16.1 MiB/s
INFO:  41% (332.1 GiB of 810.0 GiB) in 5h 11m 50s, read: 25.2 MiB/s, write: 25.2 MiB/s
INFO:  42% (340.2 GiB of 810.0 GiB) in 5h 16m 12s, read: 31.7 MiB/s, write: 31.7 MiB/s
INFO:  43% (348.3 GiB of 810.0 GiB) in 5h 21m 24s, read: 26.6 MiB/s, write: 26.6 MiB/s
INFO:  44% (356.4 GiB of 810.0 GiB) in 5h 26m 59s, read: 24.8 MiB/s, write: 24.8 MiB/s
INFO:  45% (364.5 GiB of 810.0 GiB) in 5h 32m 11s, read: 26.6 MiB/s, write: 26.6 MiB/s
INFO:  46% (372.6 GiB of 810.0 GiB) in 5h 36m 54s, read: 29.3 MiB/s, write: 29.3 MiB/s
INFO:  47% (380.7 GiB of 810.0 GiB) in 5h 45m 25s, read: 16.2 MiB/s, write: 16.2 MiB/s
INFO:  48% (388.8 GiB of 810.0 GiB) in 5h 51m 31s, read: 22.6 MiB/s, write: 22.6 MiB/s
INFO:  49% (396.9 GiB of 810.0 GiB) in 5h 59m 9s, read: 18.1 MiB/s, write: 18.1 MiB/s
INFO:  50% (405.0 GiB of 810.0 GiB) in 6h 9m 5s, read: 13.9 MiB/s, write: 13.9 MiB/s
INFO:  51% (413.1 GiB of 810.0 GiB) in 6h 17m 57s, read: 15.6 MiB/s, write: 15.6 MiB/s
INFO:  52% (421.2 GiB of 810.0 GiB) in 6h 29m 24s, read: 12.1 MiB/s, write: 12.1 MiB/s
INFO:  53% (429.3 GiB of 810.0 GiB) in 6h 38m 1s, read: 16.1 MiB/s, write: 16.0 MiB/s
INFO:  54% (437.4 GiB of 810.0 GiB) in 6h 47m 18s, read: 14.9 MiB/s, write: 14.9 MiB/s
INFO:  55% (445.5 GiB of 810.0 GiB) in 6h 57m 38s, read: 13.4 MiB/s, write: 13.4 MiB/s
INFO:  56% (453.6 GiB of 810.0 GiB) in 7h 5m 48s, read: 17.0 MiB/s, write: 17.0 MiB/s
INFO:  57% (461.7 GiB of 810.0 GiB) in 7h 15m 42s, read: 13.9 MiB/s, write: 13.9 MiB/s
INFO:  58% (469.8 GiB of 810.0 GiB) in 7h 25m 31s, read: 14.1 MiB/s, write: 14.1 MiB/s
INFO:  59% (477.9 GiB of 810.0 GiB) in 7h 31m 38s, read: 22.6 MiB/s, write: 22.6 MiB/s
INFO:  60% (486.0 GiB of 810.0 GiB) in 7h 36m 40s, read: 27.5 MiB/s, write: 27.4 MiB/s
INFO:  61% (494.1 GiB of 810.0 GiB) in 7h 44m 55s, read: 16.7 MiB/s, write: 16.5 MiB/s
INFO:  62% (502.2 GiB of 810.0 GiB) in 7h 53m 43s, read: 15.7 MiB/s, write: 15.7 MiB/s
INFO:  63% (510.3 GiB of 810.0 GiB) in 8h 3m 55s, read: 13.5 MiB/s, write: 13.5 MiB/s
INFO:  64% (518.4 GiB of 810.0 GiB) in 8h 14m 40s, read: 12.9 MiB/s, write: 12.9 MiB/s
INFO:  65% (526.5 GiB of 810.0 GiB) in 8h 21m 54s, read: 19.0 MiB/s, write: 19.0 MiB/s
INFO:  66% (534.6 GiB of 810.0 GiB) in 8h 31m 21s, read: 14.6 MiB/s, write: 14.6 MiB/s
INFO:  67% (542.7 GiB of 810.0 GiB) in 8h 39m 39s, read: 16.7 MiB/s, write: 16.7 MiB/s
INFO:  68% (550.8 GiB of 810.0 GiB) in 8h 46m 29s, read: 20.2 MiB/s, write: 20.2 MiB/s
INFO:  68% (552.5 GiB of 810.0 GiB) in 8h 48m 30s, read: 14.1 MiB/s, write: 14.1 MiB/s
ERROR: backup write data failed: command error: write_data upload error: pipelined request failed: No space left on device (os error 28)
INFO: aborting backup job
INFO: resume vm
ERROR: Backup of VM 103 failed - backup write data failed: command error: write_data upload error: pipelined request failed: No space left on device (os error 28)
INFO: Failed at 2021-04-06 08:13:22
INFO: Backup job finished with errors
TASK ERROR: job errors
 
When I choose PBS as a destination I see the compression is grayed out and is fixed at zstd. But in this case it seems it is not compressing.
 
no this has nothing to do with compression... can you show us the content listing of the datastore?
and a task log of a recent garbage collect ?
 
I have just deleted again the datastore because when it fills the entire machine goes down because the filesystem is full.
This evening I will do again. But please note that I am starting from scratch: this was the FIRST backup of my three VMs. So there is no log of a garbage collect: I have created the backup server just two days ago.
 
I have found some garbage collect logs:
Code: 
ProxmoxBackup Server 1.0-11
CPU
Memory
Root Disk
Bad Request (400)
ENOENT: No such file or directory
No valid subscription
You do not have a valid subscription for this server. Please visit www.proxmox.com to get a list of available options.
()
2021-04-06T00:00:00+02:00: starting garbage collection on store backups
2021-04-06T00:00:00+02:00: task triggered by schedule 'daily'
2021-04-06T00:00:00+02:00: Start GC phase1 (mark used chunks)
2021-04-06T00:00:05+02:00: marked 50% (1 of 2 index files)
2021-04-06T00:00:09+02:00: marked 100% (2 of 2 index files)
2021-04-06T00:00:09+02:00: Start GC phase2 (sweep unused chunks)
2021-04-06T00:51:30+02:00: processed 1% (1661 chunks)
2021-04-06T01:10:45+02:00: processed 2% (3417 chunks)
2021-04-06T01:11:32+02:00: processed 3% (5213 chunks)
2021-04-06T02:00:20+02:00: processed 4% (7254 chunks)
2021-04-06T02:01:10+02:00: processed 5% (9363 chunks)
2021-04-06T02:02:06+02:00: processed 6% (11486 chunks)
2021-04-06T02:03:07+02:00: processed 7% (13586 chunks)
2021-04-06T02:03:59+02:00: processed 8% (15751 chunks)
2021-04-06T02:04:46+02:00: processed 9% (17941 chunks)
2021-04-06T02:05:14+02:00: processed 10% (20155 chunks)
2021-04-06T02:08:43+02:00: processed 11% (22291 chunks)
2021-04-06T02:09:23+02:00: processed 12% (24556 chunks)
2021-04-06T02:10:09+02:00: processed 13% (26711 chunks)
2021-04-06T02:19:52+02:00: processed 14% (29009 chunks)
2021-04-06T02:35:44+02:00: processed 15% (31313 chunks)
2021-04-06T02:36:23+02:00: processed 16% (33690 chunks)
2021-04-06T02:36:59+02:00: processed 17% (36102 chunks)
2021-04-06T02:37:44+02:00: processed 18% (38563 chunks)
2021-04-06T02:38:34+02:00: processed 19% (40790 chunks)
2021-04-06T02:40:24+02:00: processed 20% (43208 chunks)
2021-04-06T03:01:38+02:00: processed 21% (45642 chunks)
2021-04-06T03:07:41+02:00: processed 22% (48155 chunks)
2021-04-06T03:08:51+02:00: processed 23% (50668 chunks)
2021-04-06T03:09:20+02:00: processed 24% (53172 chunks)
2021-04-06T03:09:47+02:00: processed 25% (55724 chunks)
2021-04-06T03:10:12+02:00: processed 26% (58290 chunks)
2021-04-06T03:10:38+02:00: processed 27% (60935 chunks)
2021-04-06T03:11:04+02:00: processed 28% (63482 chunks)
2021-04-06T03:11:35+02:00: processed 29% (66024 chunks)
2021-04-06T03:12:06+02:00: processed 30% (68520 chunks)
2021-04-06T03:12:32+02:00: processed 31% (71023 chunks)
2021-04-06T03:12:56+02:00: processed 32% (73576 chunks)
2021-04-06T03:13:16+02:00: processed 33% (76111 chunks)
2021-04-06T03:13:36+02:00: processed 34% (78733 chunks)
2021-04-06T03:13:58+02:00: processed 35% (81346 chunks)
2021-04-06T03:14:17+02:00: processed 36% (83958 chunks)
2021-04-06T03:14:38+02:00: processed 37% (86587 chunks)
2021-04-06T03:14:57+02:00: processed 38% (89128 chunks)
2021-04-06T03:15:16+02:00: processed 39% (91668 chunks)
2021-04-06T03:15:35+02:00: processed 40% (94319 chunks)
2021-04-06T03:15:55+02:00: processed 41% (96841 chunks)
2021-04-06T03:16:15+02:00: processed 42% (99476 chunks)
2021-04-06T03:16:32+02:00: processed 43% (102084 chunks)
2021-04-06T03:16:50+02:00: processed 44% (104659 chunks)
2021-04-06T03:17:08+02:00: processed 45% (107264 chunks)
2021-04-06T03:17:26+02:00: processed 46% (109758 chunks)
2021-04-06T03:17:43+02:00: processed 47% (112282 chunks)
2021-04-06T03:18:01+02:00: processed 48% (114814 chunks)
2021-04-06T03:18:19+02:00: processed 49% (117435 chunks)
2021-04-06T03:18:37+02:00: processed 50% (119973 chunks)
2021-04-06T03:19:41+02:00: processed 51% (122558 chunks)
2021-04-06T03:21:03+02:00: processed 52% (125122 chunks)
2021-04-06T03:22:15+02:00: processed 53% (127614 chunks)
2021-04-06T03:22:52+02:00: processed 54% (130116 chunks)
2021-04-06T03:23:28+02:00: processed 55% (132696 chunks)
2021-04-06T03:23:50+02:00: processed 56% (135309 chunks)
2021-04-06T03:24:10+02:00: processed 57% (137958 chunks)
2021-04-06T03:24:31+02:00: processed 58% (140498 chunks)
2021-04-06T03:24:50+02:00: processed 59% (143056 chunks)
2021-04-06T03:25:11+02:00: processed 60% (145674 chunks)
2021-04-06T03:25:31+02:00: processed 61% (148217 chunks)
2021-04-06T03:25:51+02:00: processed 62% (150817 chunks)
2021-04-06T03:26:12+02:00: processed 63% (153487 chunks)
2021-04-06T03:26:31+02:00: processed 64% (156115 chunks)
2021-04-06T03:26:51+02:00: processed 65% (158727 chunks)
2021-04-06T03:27:11+02:00: processed 66% (161237 chunks)
2021-04-06T03:27:29+02:00: processed 67% (163748 chunks)
2021-04-06T03:27:47+02:00: processed 68% (166345 chunks)
2021-04-06T03:28:05+02:00: processed 69% (168944 chunks)
2021-04-06T03:28:22+02:00: processed 70% (171592 chunks)
2021-04-06T03:28:42+02:00: processed 71% (174207 chunks)
2021-04-06T03:28:59+02:00: processed 72% (176845 chunks)
2021-04-06T03:29:18+02:00: processed 73% (179436 chunks)
2021-04-06T03:29:36+02:00: processed 74% (182171 chunks)
2021-04-06T03:29:54+02:00: processed 75% (184773 chunks)
2021-04-06T03:30:13+02:00: processed 76% (187341 chunks)
2021-04-06T03:30:32+02:00: processed 77% (189974 chunks)
2021-04-06T03:30:51+02:00: processed 78% (192507 chunks)
2021-04-06T03:31:07+02:00: processed 79% (195044 chunks)
2021-04-06T03:31:24+02:00: processed 80% (197635 chunks)
2021-04-06T03:31:39+02:00: processed 81% (200293 chunks)
2021-04-06T03:31:55+02:00: processed 82% (203003 chunks)
2021-04-06T03:32:11+02:00: processed 83% (205630 chunks)
2021-04-06T03:32:27+02:00: processed 84% (208248 chunks)
2021-04-06T03:32:42+02:00: processed 85% (210891 chunks)
2021-04-06T03:32:58+02:00: processed 86% (213565 chunks)
2021-04-06T03:33:13+02:00: processed 87% (216096 chunks)
2021-04-06T03:33:28+02:00: processed 88% (218726 chunks)
2021-04-06T03:33:43+02:00: processed 89% (221408 chunks)
2021-04-06T03:33:57+02:00: processed 90% (223989 chunks)
2021-04-06T03:34:13+02:00: processed 91% (226572 chunks)
2021-04-06T03:34:27+02:00: processed 92% (229147 chunks)
2021-04-06T03:34:42+02:00: processed 93% (231765 chunks)
2021-04-06T03:34:56+02:00: processed 94% (234390 chunks)
2021-04-06T03:35:11+02:00: processed 95% (237039 chunks)
2021-04-06T03:35:25+02:00: processed 96% (239665 chunks)
2021-04-06T03:35:40+02:00: processed 97% (242316 chunks)
2021-04-06T03:35:54+02:00: processed 98% (244878 chunks)
2021-04-06T03:36:08+02:00: processed 99% (247463 chunks)
2021-04-06T03:36:24+02:00: Removed garbage: 0 B
2021-04-06T03:36:24+02:00: Removed chunks: 0
2021-04-06T03:36:24+02:00: Original data usage: 1.27 TiB
2021-04-06T03:36:24+02:00: On-Disk usage: 593.75 GiB (45.67%)
2021-04-06T03:36:24+02:00: On-Disk chunks: 250052
2021-04-06T03:36:24+02:00: Deduplication factor: 2.19
2021-04-06T03:36:24+02:00: Average chunk size: 2.43 MiB
2021-04-06T03:36:24+02:00: TASK OK
 
Code: 
ProxmoxBackup Server 1.0-11
CPU
Memory
Root Disk
Bad Request (400)
ENOENT: No such file or directory
No valid subscription
You do not have a valid subscription for this server. Please visit www.proxmox.com to get a list of available options.
()
2021-04-05T00:00:00+02:00: starting garbage collection on store backups
2021-04-05T00:00:00+02:00: task triggered by schedule 'daily'
2021-04-05T00:00:00+02:00: Start GC phase1 (mark used chunks)
2021-04-05T01:16:57+02:00: marked 20% (1 of 5 index files)
2021-04-05T01:18:46+02:00: marked 40% (2 of 5 index files)
2021-04-05T01:18:47+02:00: marked 60% (3 of 5 index files)
2021-04-05T01:23:21+02:00: marked 80% (4 of 5 index files)
2021-04-05T01:57:40+02:00: marked 100% (5 of 5 index files)
2021-04-05T01:57:40+02:00: Start GC phase2 (sweep unused chunks)
2021-04-05T01:58:33+02:00: processed 1% (3219 chunks)
2021-04-05T02:00:28+02:00: processed 2% (6557 chunks)
2021-04-05T02:03:38+02:00: processed 3% (9864 chunks)
2021-04-05T02:05:05+02:00: processed 4% (13181 chunks)
2021-04-05T02:07:49+02:00: processed 5% (16515 chunks)
2021-04-05T02:09:00+02:00: processed 6% (19819 chunks)
2021-04-05T02:10:20+02:00: processed 7% (23237 chunks)
2021-04-05T02:13:21+02:00: processed 8% (26693 chunks)
2021-04-05T02:15:07+02:00: processed 9% (30137 chunks)
2021-04-05T02:16:13+02:00: processed 10% (33584 chunks)
2021-04-05T02:17:20+02:00: processed 11% (36903 chunks)
2021-04-05T02:18:51+02:00: processed 12% (40363 chunks)
2021-04-05T02:20:24+02:00: processed 13% (43840 chunks)
2021-04-05T02:23:40+02:00: processed 14% (47378 chunks)
2021-04-05T02:26:53+02:00: processed 15% (50892 chunks)
2021-04-05T02:28:11+02:00: processed 16% (54411 chunks)
2021-04-05T02:31:11+02:00: processed 17% (57915 chunks)
2021-04-05T02:32:51+02:00: processed 18% (61472 chunks)
2021-04-05T02:34:16+02:00: processed 19% (64872 chunks)
2021-04-05T02:34:51+02:00: processed 20% (68414 chunks)
2021-04-05T02:35:28+02:00: processed 21% (72005 chunks)
2021-04-05T02:36:05+02:00: processed 22% (75532 chunks)
2021-04-05T02:37:18+02:00: processed 23% (79009 chunks)
2021-04-05T02:40:16+02:00: processed 24% (82544 chunks)
2021-04-05T02:42:24+02:00: processed 25% (86153 chunks)
2021-04-05T02:44:53+02:00: processed 26% (89794 chunks)
2021-04-05T02:49:31+02:00: processed 27% (93496 chunks)
2021-04-05T02:56:18+02:00: processed 28% (97103 chunks)
2021-04-05T02:57:19+02:00: processed 29% (100654 chunks)
2021-04-05T02:57:40+02:00: processed 30% (104232 chunks)
2021-04-05T02:58:50+02:00: processed 31% (107777 chunks)
2021-04-05T03:06:08+02:00: processed 32% (111476 chunks)
2021-04-05T03:06:28+02:00: processed 33% (115089 chunks)
2021-04-05T03:06:49+02:00: processed 34% (118821 chunks)
2021-04-05T03:07:11+02:00: processed 35% (122516 chunks)
2021-04-05T03:08:56+02:00: processed 36% (126294 chunks)
2021-04-05T03:13:21+02:00: processed 38% (133772 chunks)
2021-04-05T03:13:41+02:00: processed 39% (137432 chunks)
2021-04-05T03:14:03+02:00: processed 40% (141188 chunks)
2021-04-05T03:14:27+02:00: processed 41% (144810 chunks)
2021-04-05T03:14:47+02:00: processed 42% (148489 chunks)
2021-04-05T03:15:10+02:00: processed 43% (152240 chunks)
2021-04-05T03:15:32+02:00: processed 44% (155909 chunks)
2021-04-05T03:15:53+02:00: processed 45% (159651 chunks)
2021-04-05T03:16:16+02:00: processed 46% (163275 chunks)
2021-04-05T03:16:37+02:00: processed 47% (166965 chunks)
2021-04-05T03:16:57+02:00: processed 48% (170618 chunks)
2021-04-05T03:17:21+02:00: processed 49% (174355 chunks)
2021-04-05T03:17:41+02:00: processed 50% (177985 chunks)
2021-04-05T03:18:02+02:00: processed 51% (181672 chunks)
2021-04-05T03:18:24+02:00: processed 52% (185330 chunks)
2021-04-05T03:18:45+02:00: processed 53% (189044 chunks)
2021-04-05T03:19:05+02:00: processed 54% (192719 chunks)
2021-04-05T03:19:28+02:00: processed 55% (196428 chunks)
2021-04-05T03:19:48+02:00: processed 56% (200149 chunks)
2021-04-05T03:20:08+02:00: processed 57% (203931 chunks)
2021-04-05T03:20:30+02:00: processed 58% (207577 chunks)
2021-04-05T03:20:48+02:00: processed 59% (211193 chunks)
2021-04-05T03:21:07+02:00: processed 60% (214927 chunks)
2021-04-05T03:21:29+02:00: processed 61% (218548 chunks)
2021-04-05T03:21:47+02:00: processed 62% (222260 chunks)
2021-04-05T03:22:08+02:00: processed 63% (226007 chunks)
2021-04-05T03:22:30+02:00: processed 64% (229727 chunks)
2021-04-05T03:22:50+02:00: processed 65% (233499 chunks)
2021-04-05T03:23:12+02:00: processed 66% (237093 chunks)
2021-04-05T03:23:32+02:00: processed 67% (240654 chunks)
2021-04-05T03:23:53+02:00: processed 68% (244312 chunks)
2021-04-05T03:24:15+02:00: processed 69% (248005 chunks)
2021-04-05T03:24:34+02:00: processed 70% (251739 chunks)
2021-04-05T03:24:53+02:00: processed 71% (255535 chunks)
2021-04-05T03:25:15+02:00: processed 72% (259262 chunks)
2021-04-05T03:25:35+02:00: processed 73% (262950 chunks)
2021-04-05T03:25:54+02:00: processed 74% (266709 chunks)
2021-04-05T03:26:18+02:00: processed 75% (270395 chunks)
2021-04-05T03:26:39+02:00: processed 76% (274095 chunks)
2021-04-05T03:26:58+02:00: processed 77% (277787 chunks)
2021-04-05T03:27:21+02:00: processed 78% (281478 chunks)
2021-04-05T03:27:41+02:00: processed 79% (285031 chunks)
2021-04-05T03:28:01+02:00: processed 80% (288705 chunks)
2021-04-05T03:28:23+02:00: processed 81% (292466 chunks)
2021-04-05T03:28:42+02:00: processed 82% (296209 chunks)
2021-04-05T03:29:02+02:00: processed 83% (299875 chunks)
2021-04-05T03:29:24+02:00: processed 84% (303644 chunks)
2021-04-05T03:29:44+02:00: processed 85% (307313 chunks)
2021-04-05T03:30:04+02:00: processed 86% (311019 chunks)
2021-04-05T03:30:28+02:00: processed 87% (314680 chunks)
2021-04-05T03:30:47+02:00: processed 88% (318332 chunks)
2021-04-05T03:31:07+02:00: processed 89% (322079 chunks)
2021-04-05T03:31:30+02:00: processed 90% (325740 chunks)
2021-04-05T03:31:50+02:00: processed 91% (329389 chunks)
2021-04-05T03:32:13+02:00: processed 92% (332986 chunks)
2021-04-05T03:32:33+02:00: processed 93% (336614 chunks)
2021-04-05T03:32:52+02:00: processed 94% (340356 chunks)
2021-04-05T03:33:16+02:00: processed 95% (344057 chunks)
2021-04-05T03:33:36+02:00: processed 96% (347709 chunks)
2021-04-05T03:33:56+02:00: processed 97% (351373 chunks)
2021-04-05T03:34:20+02:00: processed 98% (354939 chunks)
2021-04-05T03:34:41+02:00: processed 99% (358571 chunks)
2021-04-05T03:35:01+02:00: Removed garbage: 0 B
2021-04-05T03:35:01+02:00: Removed chunks: 0
2021-04-05T03:35:01+02:00: Pending removals: 382.22 MiB (in 213 chunks)
2021-04-05T03:35:01+02:00: Original data usage: 863.40 GiB
2021-04-05T03:35:01+02:00: On-Disk usage: 704.14 GiB (81.55%)
2021-04-05T03:35:01+02:00: On-Disk chunks: 362043
2021-04-05T03:35:01+02:00: Deduplication factor: 1.23
2021-04-05T03:35:01+02:00: Average chunk size: 1.99 MiB
2021-04-05T03:35:03+02:00: TASK OK
 
can you post the versions from the client and server side?
 
This is the backup log in proxmox server:
Code: 
2021-04-05T23:24:50+02:00: starting new backup on datastore 'backups': "vm/103/2021-04-05T21:24:47Z"
2021-04-05T23:24:50+02:00: GET /previous: 400 Bad Request: no valid previous backup
2021-04-05T23:24:50+02:00: created new fixed index 1 ("vm/103/2021-04-05T21:24:47Z/drive-scsi0.img.fidx")
2021-04-05T23:24:50+02:00: created new fixed index 2 ("vm/103/2021-04-05T21:24:47Z/drive-scsi1.img.fidx")
2021-04-05T23:24:50+02:00: add blob "/backups/vm/103/2021-04-05T21:24:47Z/qemu-server.conf.blob" (318 bytes, comp: 318)
2021-04-06T08:13:19+02:00: TASK ERROR: connection error: bytes remaining on stream
 
So what's happened? It is a PBS just installed I do not understand because this one does not want to work correctly.
 
please post the info i requested, else i cannot help you
df -h
content listing
versions of server and client
also a task log from a regular vzdump (non pbs) would be helpful to see the resulting sizes
 
dcsapak said:
please post the info i requested, else i cannot help you
df -h
Click to expand...

I cannot give you easily a df -h because I have to start a backup cycle. Then the disk is full and so gui and all services will stop. Anyway I will try.
dcsapak said:
content listing
Click to expand...
Explain please
dcsapak said:
versions of server and client
Click to expand...
Proxmox 6.3-6 PBS 1.0-11
dcsapak said:
also a task log from a regular vzdump (non pbs) would be helpful to see the resulting sizes
Click to expand...
I have already extracted them from vzdump in the first post: vma.gz of 390, 270, 59 gb (this are gzip compressed, not zstd)
 
mgiammarco said:
I cannot give you easily a df -h because I have to start a backup cycle. Then the disk is full and so gui and all services will stop. Anyway I will try.
Click to expand...

This is df -h before backups:

Code: 
Filesystem        Size  Used Avail Use% Mounted on
udev              3.9G     0  3.9G   0% /dev
tmpfs             787M   81M  706M  11% /run
rpool/ROOT/pbs-1  1.5T  2.2G  1.5T   1% /
tmpfs             3.9G   88K  3.9G   1% /dev/shm
tmpfs             5.0M     0  5.0M   0% /run/lock
tmpfs             3.9G     0  3.9G   0% /sys/fs/cgroup
rpool             1.5T  128K  1.5T   1% /rpool
rpool/ROOT        1.5T  128K  1.5T   1% /rpool/ROOT
tmpfs             787M     0  787M   0% /run/user/0
 
mgiammarco said:
Explain please
Click to expand...
the content of the pbs datastore e.g., 'proxmox-backup-client snapshot list'

mgiammarco said:
Proxmox 6.3-6 PBS 1.0-11
Click to expand...
please provide the full version listings: 'pveversion -v' and 'proxmox-backup-manager versions --verbose'

mgiammarco said:
I have already extracted them from vzdump in the first post: vma.gz of 390, 270, 59 gb (this are gzip compressed, not zstd)
Click to expand...
the resultings size was not the only reason i wanted to see the task log, also the intermittent sparse size, etc.

mgiammarco said:
This is df -h before backups:
Click to expand...
ok, what is the path to your datastore? (you can check this in /etc/proxmox-backup/datastore.cfg or in the summary tab of the datastore)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom