Issue regarding Backup-deletion (whole group)

Nov 13, 2023
18
0
1
Hello everyone,

we're currently facing issues regarding deletion of backup groups. As shown by the output of the following command, there are no Snapshots left.

In the GUI the group has successfully been purged, but the datastore still reports no space freed. 1445-minute window for retention has already gone by.

Code:
root@PBS1:~# ls -lsh /tank/backup01/host/Backup01-backuppool-backup_sw-1
 
total 4.5K
 
4.5K -rw-r--r-- 1 backup backup 25 Oct 26  2023 owner

Do you know how to delete the group and free associated chunks?
Any other advice?

Thanks in Advance!
 
Last edited:
Hi,
several GC have already completed not relinquishing storage space. In prune jobs the log reports like following.
Code:
...
2024-06-13T00:00:00+02:00: Pruning group :"host/backup01-pool-[groupTOdelete]"
2024-06-13T00:00:00+02:00: Pruning group : ...

PS.: Can deleting whole storage groups as opposed to deleting all Snapshots in a group account for a difference? (Everything via GUI)
 
Last edited:
Hi!
could you please post the log of the last GC Job? Mind you that the garbage collection will only mark the unused chunks as `pruned` but not actually delete them. The deletion will happen after you run the GC Job again after 24 hours.

PS.: Can deleting whole storage groups as opposed to deleting all Snapshots in a group account for a difference? (Everything via GUI)
I assume with 'storage groups' you mean backup groups, and no, that won't make a difference.
 
The last GC-log:
Code:
2024-06-12T10:54:14+02:00: starting garbage collection on store backup01
2024-06-12T10:54:14+02:00: Start GC phase1 (mark used chunks)
2024-06-12T10:59:51+02:00: marked 1% (2 of 200 index files)
2024-06-12T11:00:24+02:00: marked 2% (4 of 200 index files)
2024-06-12T11:02:22+02:00: marked 3% (6 of 200 index files)
2024-06-12T11:02:35+02:00: marked 4% (8 of 200 index files)
2024-06-12T11:03:06+02:00: marked 5% (10 of 200 index files)
2024-06-12T11:03:23+02:00: marked 6% (12 of 200 index files)
2024-06-12T11:03:23+02:00: marked 7% (14 of 200 index files)
2024-06-12T11:03:28+02:00: marked 8% (16 of 200 index files)
2024-06-12T11:03:28+02:00: marked 9% (18 of 200 index files)
2024-06-12T11:05:37+02:00: marked 10% (20 of 200 index files)
2024-06-12T11:06:51+02:00: marked 11% (22 of 200 index files)
2024-06-12T11:07:28+02:00: marked 12% (24 of 200 index files)
2024-06-12T11:07:31+02:00: marked 13% (26 of 200 index files)
2024-06-12T11:07:45+02:00: marked 14% (28 of 200 index files)
2024-06-12T11:07:47+02:00: marked 15% (30 of 200 index files)
2024-06-12T11:07:47+02:00: marked 16% (32 of 200 index files)
2024-06-12T11:07:47+02:00: marked 17% (34 of 200 index files)
2024-06-12T11:09:59+02:00: marked 18% (36 of 200 index files)
2024-06-12T11:15:32+02:00: marked 19% (38 of 200 index files)
2024-06-12T11:15:34+02:00: marked 20% (40 of 200 index files)
2024-06-12T11:15:36+02:00: marked 21% (42 of 200 index files)
2024-06-12T11:15:36+02:00: marked 22% (44 of 200 index files)
2024-06-12T11:15:36+02:00: marked 23% (46 of 200 index files)
2024-06-12T11:26:35+02:00: marked 24% (48 of 200 index files)
2024-06-12T11:27:40+02:00: marked 25% (50 of 200 index files)
2024-06-12T11:27:40+02:00: marked 26% (52 of 200 index files)
2024-06-12T11:29:57+02:00: marked 27% (54 of 200 index files)
2024-06-12T11:31:26+02:00: marked 28% (56 of 200 index files)
2024-06-12T11:32:03+02:00: marked 29% (58 of 200 index files)
2024-06-12T11:32:04+02:00: marked 30% (60 of 200 index files)
2024-06-12T11:40:09+02:00: marked 31% (62 of 200 index files)
2024-06-12T11:43:29+02:00: marked 32% (64 of 200 index files)
2024-06-12T11:44:24+02:00: marked 33% (66 of 200 index files)
2024-06-12T11:45:08+02:00: marked 34% (68 of 200 index files)
2024-06-12T11:46:36+02:00: marked 35% (70 of 200 index files)
2024-06-12T11:47:36+02:00: marked 36% (72 of 200 index files)
2024-06-12T11:47:36+02:00: marked 37% (74 of 200 index files)
2024-06-12T11:47:36+02:00: marked 38% (76 of 200 index files)
2024-06-12T11:49:43+02:00: marked 39% (78 of 200 index files)
2024-06-12T11:50:52+02:00: marked 40% (80 of 200 index files)
2024-06-12T11:51:58+02:00: marked 41% (82 of 200 index files)
2024-06-12T11:52:02+02:00: marked 42% (84 of 200 index files)
2024-06-12T11:52:02+02:00: marked 43% (86 of 200 index files)
2024-06-12T11:53:19+02:00: marked 44% (88 of 200 index files)
2024-06-12T11:54:05+02:00: marked 45% (90 of 200 index files)
2024-06-12T11:55:06+02:00: marked 46% (92 of 200 index files)
2024-06-12T11:55:09+02:00: marked 47% (94 of 200 index files)
2024-06-12T11:55:48+02:00: marked 48% (96 of 200 index files)
2024-06-12T11:55:48+02:00: marked 49% (98 of 200 index files)
2024-06-12T11:56:05+02:00: marked 50% (100 of 200 index files)
2024-06-12T11:56:15+02:00: marked 51% (102 of 200 index files)
2024-06-12T11:56:57+02:00: marked 52% (104 of 200 index files)
2024-06-12T11:56:57+02:00: marked 53% (106 of 200 index files)
2024-06-12T11:56:57+02:00: marked 54% (108 of 200 index files)
2024-06-12T11:57:04+02:00: marked 55% (110 of 200 index files)
2024-06-12T11:58:31+02:00: marked 56% (112 of 200 index files)
2024-06-12T12:01:38+02:00: marked 57% (114 of 200 index files)
2024-06-12T12:02:50+02:00: marked 58% (116 of 200 index files)
2024-06-12T12:02:51+02:00: marked 59% (118 of 200 index files)
2024-06-12T12:03:19+02:00: marked 60% (120 of 200 index files)
2024-06-12T12:03:21+02:00: marked 61% (122 of 200 index files)
2024-06-12T12:03:21+02:00: marked 62% (124 of 200 index files)
2024-06-12T12:03:21+02:00: marked 63% (126 of 200 index files)
2024-06-12T12:03:28+02:00: marked 64% (128 of 200 index files)
2024-06-12T12:03:37+02:00: marked 65% (130 of 200 index files)
2024-06-12T12:03:51+02:00: marked 66% (132 of 200 index files)
2024-06-12T12:03:53+02:00: marked 67% (134 of 200 index files)
2024-06-12T12:03:53+02:00: marked 68% (136 of 200 index files)
2024-06-12T12:04:06+02:00: marked 69% (138 of 200 index files)
2024-06-12T12:04:07+02:00: marked 70% (140 of 200 index files)
2024-06-12T12:05:21+02:00: marked 71% (142 of 200 index files)
2024-06-12T12:06:06+02:00: marked 72% (144 of 200 index files)
2024-06-12T12:06:39+02:00: marked 73% (146 of 200 index files)
2024-06-12T12:06:39+02:00: marked 74% (148 of 200 index files)
2024-06-12T12:08:24+02:00: marked 75% (150 of 200 index files)
2024-06-12T12:08:24+02:00: marked 76% (152 of 200 index files)
2024-06-12T12:08:25+02:00: marked 77% (154 of 200 index files)
2024-06-12T12:14:47+02:00: marked 78% (156 of 200 index files)
2024-06-12T12:14:47+02:00: marked 79% (158 of 200 index files)
2024-06-12T12:14:57+02:00: marked 80% (160 of 200 index files)
2024-06-12T12:15:55+02:00: marked 81% (162 of 200 index files)
2024-06-12T12:18:25+02:00: marked 82% (164 of 200 index files)
2024-06-12T12:18:25+02:00: marked 83% (166 of 200 index files)
2024-06-12T12:19:09+02:00: marked 84% (168 of 200 index files)
2024-06-12T12:19:19+02:00: marked 85% (170 of 200 index files)
2024-06-12T12:19:20+02:00: marked 86% (172 of 200 index files)
2024-06-12T12:19:20+02:00: marked 87% (174 of 200 index files)
2024-06-12T12:19:26+02:00: marked 88% (176 of 200 index files)
2024-06-12T12:19:27+02:00: marked 89% (178 of 200 index files)
2024-06-12T12:20:20+02:00: marked 90% (180 of 200 index files)
2024-06-12T12:20:21+02:00: marked 91% (182 of 200 index files)
2024-06-12T12:20:21+02:00: marked 92% (184 of 200 index files)
2024-06-12T12:20:44+02:00: marked 93% (186 of 200 index files)
2024-06-12T12:21:21+02:00: marked 94% (188 of 200 index files)
2024-06-12T12:21:41+02:00: marked 95% (190 of 200 index files)
2024-06-12T12:21:42+02:00: marked 96% (192 of 200 index files)
2024-06-12T12:22:04+02:00: marked 97% (194 of 200 index files)
2024-06-12T12:22:05+02:00: marked 98% (196 of 200 index files)
2024-06-12T12:22:13+02:00: marked 99% (198 of 200 index files)
2024-06-12T12:22:38+02:00: marked 100% (200 of 200 index files)
2024-06-12T12:22:38+02:00: Start GC phase2 (sweep unused chunks)
2024-06-12T12:23:47+02:00: processed 1% (986401 chunks)
2024-06-12T12:24:51+02:00: processed 2% (1970967 chunks)
2024-06-12T12:29:46+02:00: processed 3% (2957066 chunks)
2024-06-12T12:30:53+02:00: processed 4% (3941722 chunks)
2024-06-12T12:32:01+02:00: processed 5% (4925992 chunks)
2024-06-12T12:33:10+02:00: processed 6% (5915537 chunks)
2024-06-12T12:34:16+02:00: processed 7% (6901841 chunks)
2024-06-12T12:36:08+02:00: processed 8% (7887536 chunks)
2024-06-12T12:37:21+02:00: processed 9% (8875633 chunks)
2024-06-12T12:38:34+02:00: processed 10% (9860252 chunks)
2024-06-12T12:39:50+02:00: processed 11% (10844685 chunks)
2024-06-12T12:41:07+02:00: processed 12% (11831849 chunks)
2024-06-12T12:42:23+02:00: processed 13% (12817784 chunks)
2024-06-12T12:43:30+02:00: processed 14% (13803514 chunks)
2024-06-12T12:44:36+02:00: processed 15% (14788968 chunks)
2024-06-12T12:45:39+02:00: processed 16% (15775636 chunks)
2024-06-12T12:46:41+02:00: processed 17% (16763528 chunks)
2024-06-12T12:47:43+02:00: processed 18% (17748205 chunks)
2024-06-12T12:48:44+02:00: processed 19% (18733462 chunks)
2024-06-12T12:49:44+02:00: processed 20% (19721387 chunks)
2024-06-12T12:50:43+02:00: processed 21% (20705958 chunks)
2024-06-12T12:51:41+02:00: processed 22% (21691224 chunks)
2024-06-12T12:52:37+02:00: processed 23% (22678003 chunks)
2024-06-12T12:53:35+02:00: processed 24% (23663841 chunks)
2024-06-12T12:54:31+02:00: processed 25% (24651342 chunks)
2024-06-12T12:55:26+02:00: processed 26% (25639259 chunks)
2024-06-12T12:56:22+02:00: processed 27% (26625773 chunks)
2024-06-12T12:57:18+02:00: processed 28% (27613221 chunks)
2024-06-12T12:58:14+02:00: processed 29% (28598837 chunks)
2024-06-12T12:59:09+02:00: processed 30% (29584779 chunks)
2024-06-12T13:00:03+02:00: processed 31% (30573328 chunks)
2024-06-12T13:00:57+02:00: processed 32% (31560516 chunks)
2024-06-12T13:01:52+02:00: processed 33% (32547514 chunks)
2024-06-12T13:02:46+02:00: processed 34% (33535393 chunks)
2024-06-12T13:03:40+02:00: processed 35% (34520538 chunks)
2024-06-12T13:04:34+02:00: processed 36% (35507609 chunks)
2024-06-12T13:05:30+02:00: processed 37% (36495889 chunks)
2024-06-12T13:06:25+02:00: processed 38% (37481773 chunks)
2024-06-12T13:07:20+02:00: processed 39% (38468461 chunks)
2024-06-12T13:08:14+02:00: processed 40% (39453129 chunks)
2024-06-12T13:09:08+02:00: processed 41% (40438460 chunks)
2024-06-12T13:10:02+02:00: processed 42% (41426160 chunks)
2024-06-12T13:10:56+02:00: processed 43% (42411082 chunks)
2024-06-12T13:11:50+02:00: processed 44% (43395228 chunks)
2024-06-12T13:12:44+02:00: processed 45% (44384025 chunks)
2024-06-12T13:13:38+02:00: processed 46% (45370413 chunks)
2024-06-12T13:14:31+02:00: processed 47% (46354666 chunks)
2024-06-12T13:15:26+02:00: processed 48% (47342946 chunks)
2024-06-12T13:16:19+02:00: processed 49% (48329558 chunks)
2024-06-12T13:17:12+02:00: processed 50% (49317417 chunks)
2024-06-12T13:18:05+02:00: processed 51% (50305481 chunks)
2024-06-12T13:18:58+02:00: processed 52% (51289494 chunks)
2024-06-12T13:19:51+02:00: processed 53% (52276964 chunks)
2024-06-12T13:20:44+02:00: processed 54% (53263664 chunks)
2024-06-12T13:21:36+02:00: processed 55% (54251247 chunks)
2024-06-12T13:22:26+02:00: processed 56% (55237519 chunks)
2024-06-12T13:23:16+02:00: processed 57% (56223975 chunks)
2024-06-12T13:24:05+02:00: processed 58% (57208162 chunks)
2024-06-12T13:25:10+02:00: processed 59% (58195651 chunks)
2024-06-12T13:26:05+02:00: processed 60% (59183640 chunks)
2024-06-12T13:27:01+02:00: processed 61% (60169745 chunks)
2024-06-12T13:28:28+02:00: processed 62% (61156635 chunks)
2024-06-12T13:29:37+02:00: processed 63% (62142796 chunks)
2024-06-12T13:30:36+02:00: processed 64% (63129570 chunks)
2024-06-12T13:31:29+02:00: processed 65% (64116286 chunks)
2024-06-12T13:32:19+02:00: processed 66% (65102500 chunks)
2024-06-12T13:33:14+02:00: processed 67% (66088535 chunks)
2024-06-12T13:34:17+02:00: processed 68% (67075049 chunks)
2024-06-12T13:35:11+02:00: processed 69% (68063061 chunks)
2024-06-12T13:36:03+02:00: processed 70% (69049219 chunks)
2024-06-12T13:36:55+02:00: processed 71% (70035172 chunks)
2024-06-12T13:37:45+02:00: processed 72% (71021654 chunks)
2024-06-12T13:38:34+02:00: processed 73% (72010337 chunks)
2024-06-12T13:39:23+02:00: processed 74% (72996021 chunks)
2024-06-12T13:40:14+02:00: processed 75% (73980702 chunks)
2024-06-12T13:41:03+02:00: processed 76% (74969629 chunks)
2024-06-12T13:41:51+02:00: processed 77% (75954797 chunks)
2024-06-12T13:42:41+02:00: processed 78% (76941860 chunks)
2024-06-12T13:43:31+02:00: processed 79% (77929127 chunks)
2024-06-12T13:44:20+02:00: processed 80% (78915906 chunks)
2024-06-12T13:45:10+02:00: processed 81% (79902759 chunks)
2024-06-12T13:45:59+02:00: processed 82% (80887939 chunks)
2024-06-12T13:46:48+02:00: processed 83% (81873507 chunks)
2024-06-12T13:47:37+02:00: processed 84% (82861828 chunks)
2024-06-12T13:48:26+02:00: processed 85% (83849151 chunks)
2024-06-12T13:49:14+02:00: processed 86% (84836547 chunks)
2024-06-12T13:50:02+02:00: processed 87% (85824295 chunks)
2024-06-12T13:50:51+02:00: processed 88% (86811559 chunks)
2024-06-12T13:51:39+02:00: processed 89% (87800218 chunks)
2024-06-12T13:52:27+02:00: processed 90% (88786019 chunks)
2024-06-12T13:53:16+02:00: processed 91% (89771703 chunks)
2024-06-12T13:54:08+02:00: processed 92% (90759403 chunks)
2024-06-12T13:54:55+02:00: processed 93% (91745557 chunks)
2024-06-12T13:55:43+02:00: processed 94% (92731772 chunks)
2024-06-12T13:56:31+02:00: processed 95% (93719502 chunks)
2024-06-12T13:57:18+02:00: processed 96% (94705059 chunks)
2024-06-12T13:58:05+02:00: processed 97% (95692802 chunks)
2024-06-12T13:58:53+02:00: processed 98% (96680189 chunks)
2024-06-12T13:59:40+02:00: processed 99% (97665199 chunks)
2024-06-12T14:00:27+02:00: Removed garbage: 0 B
2024-06-12T14:00:27+02:00: Removed chunks: 0
2024-06-12T14:00:27+02:00: Original data usage: 318.432 TiB
2024-06-12T14:00:27+02:00: On-Disk usage: 205.539 TiB (64.55%)
2024-06-12T14:00:27+02:00: On-Disk chunks: 98651437
2024-06-12T14:00:27+02:00: Deduplication factor: 1.55
2024-06-12T14:00:27+02:00: Average chunk size: 2.185 MiB
2024-06-12T14:00:27+02:00: TASK OK
 
Try running another GC more than 24 hours and 5 minutes after this one, the unused chunks should then be removed.