Reclaim space from deleted backup.

N

NomadCF

Active Member
Dec 20, 2017
28
1
43
43
We ran an experiment to see if the CLI backup client was a feasible way to backup some of our large existing file servers. After running to two backups with the CLI client we came to the conclusion that this wasn't a good fit for us. So we deleted the whole and only "host" from our PBS servers datastore via the GUI. But after waiting the needed +24 hrs. and running a prune then Garbage Collection a few times we haven't seen any available free space regained.
 
can you post the log from the garbage collect?
 
Code: 
2021-02-21T18:15:00-05:00: starting garbage collection on store storage
2021-02-21T18:15:00-05:00: task triggered by schedule 'sun 18:15'
2021-02-21T18:15:00-05:00: Start GC phase1 (mark used chunks)
2021-02-21T18:15:37-05:00: marked 1% (32 of 3127 index files)
2021-02-21T18:15:47-05:00: marked 2% (63 of 3127 index files)
2021-02-21T18:15:57-05:00: marked 3% (94 of 3127 index files)
2021-02-21T18:16:07-05:00: marked 4% (126 of 3127 index files)
2021-02-21T18:16:18-05:00: marked 5% (157 of 3127 index files)
2021-02-21T18:16:26-05:00: marked 6% (188 of 3127 index files)
2021-02-21T18:16:33-05:00: marked 7% (219 of 3127 index files)
2021-02-21T18:17:22-05:00: marked 8% (251 of 3127 index files)
2021-02-21T18:17:37-05:00: marked 9% (282 of 3127 index files)
2021-02-21T18:17:48-05:00: marked 10% (313 of 3127 index files)
2021-02-21T18:17:58-05:00: marked 11% (344 of 3127 index files)
2021-02-21T18:18:12-05:00: marked 12% (376 of 3127 index files)
2021-02-21T18:18:21-05:00: marked 13% (407 of 3127 index files)
2021-02-21T18:18:29-05:00: marked 14% (438 of 3127 index files)
2021-02-21T18:18:34-05:00: marked 15% (470 of 3127 index files)
2021-02-21T18:18:42-05:00: marked 16% (501 of 3127 index files)
2021-02-21T18:18:45-05:00: marked 17% (532 of 3127 index files)
2021-02-21T18:18:49-05:00: marked 18% (563 of 3127 index files)
2021-02-21T18:18:53-05:00: marked 19% (595 of 3127 index files)
2021-02-21T18:19:00-05:00: marked 20% (626 of 3127 index files)
2021-02-21T18:19:07-05:00: marked 21% (657 of 3127 index files)
2021-02-21T18:19:13-05:00: marked 22% (688 of 3127 index files)
2021-02-21T18:19:19-05:00: marked 23% (720 of 3127 index files)
2021-02-21T18:19:24-05:00: marked 24% (751 of 3127 index files)
2021-02-21T18:19:28-05:00: marked 25% (782 of 3127 index files)
2021-02-21T18:19:31-05:00: marked 26% (814 of 3127 index files)
2021-02-21T18:19:35-05:00: marked 27% (845 of 3127 index files)
2021-02-21T18:19:39-05:00: marked 28% (876 of 3127 index files)
2021-02-21T18:19:56-05:00: marked 29% (907 of 3127 index files)
2021-02-21T18:20:15-05:00: marked 30% (939 of 3127 index files)
2021-02-21T18:20:32-05:00: marked 31% (970 of 3127 index files)
2021-02-21T18:20:49-05:00: marked 32% (1001 of 3127 index files)
2021-02-21T18:21:09-05:00: marked 33% (1032 of 3127 index files)
2021-02-21T18:21:17-05:00: marked 34% (1064 of 3127 index files)
2021-02-21T18:21:24-05:00: marked 35% (1095 of 3127 index files)
2021-02-21T18:21:30-05:00: marked 36% (1126 of 3127 index files)
2021-02-21T18:21:37-05:00: marked 37% (1157 of 3127 index files)
2021-02-21T18:21:44-05:00: marked 38% (1189 of 3127 index files)
2021-02-21T18:21:50-05:00: marked 39% (1220 of 3127 index files)
2021-02-21T18:21:57-05:00: marked 40% (1251 of 3127 index files)
2021-02-21T18:22:01-05:00: marked 41% (1283 of 3127 index files)
2021-02-22T07:57:35-05:00: marked 42% (1314 of 3127 index files)
2021-02-22T08:20:39-05:00: marked 43% (1345 of 3127 index files)
2021-02-22T08:41:14-05:00: marked 44% (1376 of 3127 index files)
2021-02-22T08:59:20-05:00: marked 45% (1408 of 3127 index files)
2021-02-22T09:28:19-05:00: marked 46% (1439 of 3127 index files)
2021-02-22T09:28:47-05:00: marked 47% (1470 of 3127 index files)
2021-02-22T09:29:39-05:00: marked 48% (1501 of 3127 index files)
2021-02-22T09:30:21-05:00: marked 49% (1533 of 3127 index files)
2021-02-22T09:30:55-05:00: marked 50% (1564 of 3127 index files)
2021-02-22T09:31:29-05:00: marked 51% (1595 of 3127 index files)
2021-02-22T09:32:01-05:00: marked 52% (1627 of 3127 index files)
2021-02-22T10:43:50-05:00: marked 53% (1658 of 3127 index files)
2021-02-22T10:45:21-05:00: marked 54% (1689 of 3127 index files)
2021-02-22T10:46:45-05:00: marked 55% (1720 of 3127 index files)
2021-02-22T10:48:17-05:00: marked 56% (1752 of 3127 index files)
2021-02-22T10:50:02-05:00: marked 57% (1783 of 3127 index files)
2021-02-22T10:50:52-05:00: marked 58% (1814 of 3127 index files)
2021-02-22T10:52:11-05:00: marked 59% (1845 of 3127 index files)
2021-02-22T10:53:37-05:00: marked 60% (1877 of 3127 index files)
2021-02-22T10:54:31-05:00: marked 61% (1908 of 3127 index files)
2021-02-22T10:54:33-05:00: marked 62% (1939 of 3127 index files)
2021-02-22T10:54:35-05:00: marked 63% (1971 of 3127 index files)
2021-02-22T10:54:36-05:00: marked 64% (2002 of 3127 index files)
2021-02-22T10:54:38-05:00: marked 65% (2033 of 3127 index files)
2021-02-22T10:54:39-05:00: marked 66% (2064 of 3127 index files)
2021-02-22T10:54:50-05:00: marked 67% (2096 of 3127 index files)
2021-02-22T10:55:22-05:00: marked 68% (2127 of 3127 index files)
2021-02-22T10:55:38-05:00: marked 69% (2158 of 3127 index files)
2021-02-22T10:55:54-05:00: marked 70% (2189 of 3127 index files)
2021-02-22T10:59:41-05:00: marked 71% (2221 of 3127 index files)
2021-02-22T10:59:46-05:00: marked 72% (2252 of 3127 index files)
2021-02-22T11:00:23-05:00: marked 73% (2283 of 3127 index files)
2021-02-22T11:00:44-05:00: marked 74% (2314 of 3127 index files)
2021-02-22T11:01:03-05:00: marked 75% (2346 of 3127 index files)
2021-02-22T11:01:07-05:00: marked 76% (2377 of 3127 index files)
2021-02-22T11:01:09-05:00: marked 77% (2408 of 3127 index files)
2021-02-22T11:01:38-05:00: marked 78% (2440 of 3127 index files)
2021-02-22T11:01:49-05:00: marked 79% (2471 of 3127 index files)
2021-02-22T11:01:59-05:00: marked 80% (2502 of 3127 index files)
2021-02-22T11:02:10-05:00: marked 81% (2533 of 3127 index files)
2021-02-22T11:02:20-05:00: marked 82% (2565 of 3127 index files)
2021-02-22T11:02:46-05:00: marked 83% (2596 of 3127 index files)
2021-02-22T11:03:02-05:00: marked 84% (2627 of 3127 index files)
2021-02-22T11:03:36-05:00: marked 85% (2658 of 3127 index files)
2021-02-22T11:03:46-05:00: marked 86% (2690 of 3127 index files)
2021-02-22T11:03:59-05:00: marked 87% (2721 of 3127 index files)
2021-02-22T11:04:09-05:00: marked 88% (2752 of 3127 index files)
2021-02-22T11:04:14-05:00: marked 89% (2784 of 3127 index files)
2021-02-22T11:04:33-05:00: marked 90% (2815 of 3127 index files)
2021-02-22T11:04:44-05:00: marked 91% (2846 of 3127 index files)
2021-02-22T11:04:54-05:00: marked 92% (2877 of 3127 index files)
2021-02-22T11:05:06-05:00: marked 93% (2909 of 3127 index files)
2021-02-22T11:05:18-05:00: marked 94% (2940 of 3127 index files)
2021-02-22T11:05:34-05:00: marked 95% (2971 of 3127 index files)
2021-02-22T11:05:48-05:00: marked 96% (3002 of 3127 index files)
2021-02-22T11:06:00-05:00: marked 97% (3034 of 3127 index files)
2021-02-22T11:06:08-05:00: marked 98% (3065 of 3127 index files)
2021-02-22T11:06:09-05:00: marked 99% (3096 of 3127 index files)
2021-02-22T11:06:10-05:00: marked 100% (3127 of 3127 index files)
2021-02-22T11:06:10-05:00: Start GC phase2 (sweep unused chunks)
2021-02-22T11:06:18-05:00: processed 1% (41899 chunks)
2021-02-22T11:06:23-05:00: processed 2% (83620 chunks)
2021-02-22T11:06:28-05:00: processed 3% (125479 chunks)
2021-02-22T11:06:32-05:00: processed 4% (167349 chunks)
2021-02-22T11:06:35-05:00: processed 5% (209429 chunks)
2021-02-22T11:06:37-05:00: processed 6% (251536 chunks)
2021-02-22T11:06:39-05:00: processed 7% (293275 chunks)
2021-02-22T11:06:41-05:00: processed 8% (335138 chunks)
2021-02-22T11:06:42-05:00: processed 9% (377378 chunks)
2021-02-22T11:06:44-05:00: processed 10% (419270 chunks)
2021-02-22T11:06:45-05:00: processed 11% (461105 chunks)
2021-02-22T11:06:46-05:00: processed 12% (503035 chunks)
2021-02-22T11:06:46-05:00: processed 13% (544862 chunks)
2021-02-22T11:06:47-05:00: processed 14% (586849 chunks)
2021-02-22T11:06:48-05:00: processed 15% (628772 chunks)
2021-02-22T11:06:48-05:00: processed 16% (670933 chunks)
2021-02-22T11:06:49-05:00: processed 17% (713005 chunks)
2021-02-22T11:06:50-05:00: processed 18% (754492 chunks)
2021-02-22T11:06:51-05:00: processed 19% (796334 chunks)
2021-02-22T11:06:51-05:00: processed 20% (838132 chunks)
2021-02-22T11:06:52-05:00: processed 21% (879881 chunks)
2021-02-22T11:06:53-05:00: processed 22% (922178 chunks)
2021-02-22T11:06:53-05:00: processed 23% (964456 chunks)
2021-02-22T11:06:54-05:00: processed 24% (1006212 chunks)
2021-02-22T11:06:55-05:00: processed 25% (1048097 chunks)
2021-02-22T11:06:55-05:00: processed 26% (1089838 chunks)
2021-02-22T11:06:56-05:00: processed 27% (1131865 chunks)
2021-02-22T11:06:56-05:00: processed 28% (1174130 chunks)
2021-02-22T11:06:57-05:00: processed 29% (1215972 chunks)
2021-02-22T11:06:57-05:00: processed 30% (1257763 chunks)
2021-02-22T11:06:58-05:00: processed 31% (1299825 chunks)
2021-02-22T11:06:58-05:00: processed 32% (1342019 chunks)
2021-02-22T11:06:59-05:00: processed 33% (1384012 chunks)
2021-02-22T11:06:59-05:00: processed 34% (1426150 chunks)
2021-02-22T11:07:00-05:00: processed 35% (1468159 chunks)
2021-02-22T11:07:00-05:00: processed 36% (1510240 chunks)
2021-02-22T11:07:01-05:00: processed 37% (1552474 chunks)
2021-02-22T11:07:02-05:00: processed 38% (1594473 chunks)
2021-02-22T11:07:02-05:00: processed 39% (1636442 chunks)
2021-02-22T11:07:03-05:00: processed 40% (1677887 chunks)
2021-02-22T11:07:03-05:00: processed 41% (1719437 chunks)
2021-02-22T11:07:04-05:00: processed 42% (1761596 chunks)
2021-02-22T11:07:04-05:00: processed 43% (1803568 chunks)
2021-02-22T11:07:05-05:00: processed 44% (1845574 chunks)
2021-02-22T11:07:05-05:00: processed 45% (1887597 chunks)
2021-02-22T11:07:06-05:00: processed 46% (1929706 chunks)
2021-02-22T11:07:06-05:00: processed 47% (1971473 chunks)
2021-02-22T11:07:07-05:00: processed 48% (2013483 chunks)
2021-02-22T11:07:08-05:00: processed 49% (2055335 chunks)
2021-02-22T11:07:08-05:00: processed 50% (2097590 chunks)
2021-02-22T11:07:09-05:00: processed 51% (2139769 chunks)
2021-02-22T11:07:09-05:00: processed 52% (2182146 chunks)
2021-02-22T11:07:10-05:00: processed 53% (2224235 chunks)
2021-02-22T11:07:10-05:00: processed 54% (2266184 chunks)
2021-02-22T11:07:11-05:00: processed 55% (2307997 chunks)
2021-02-22T11:07:11-05:00: processed 56% (2349690 chunks)
2021-02-22T11:07:12-05:00: processed 57% (2392037 chunks)
2021-02-22T11:07:13-05:00: processed 58% (2433939 chunks)
2021-02-22T11:07:13-05:00: processed 59% (2475462 chunks)
2021-02-22T11:07:14-05:00: processed 60% (2517207 chunks)
2021-02-22T11:07:14-05:00: processed 61% (2559360 chunks)
2021-02-22T11:07:15-05:00: processed 62% (2601419 chunks)
2021-02-22T11:07:15-05:00: processed 63% (2643342 chunks)
2021-02-22T11:07:16-05:00: processed 64% (2685625 chunks)
2021-02-22T11:07:17-05:00: processed 65% (2727513 chunks)
2021-02-22T11:07:17-05:00: processed 66% (2769399 chunks)
2021-02-22T11:07:18-05:00: processed 67% (2811419 chunks)
2021-02-22T11:07:19-05:00: processed 68% (2853235 chunks)
2021-02-22T11:07:20-05:00: processed 69% (2895084 chunks)
2021-02-22T11:07:20-05:00: processed 70% (2937101 chunks)
2021-02-22T11:07:21-05:00: processed 71% (2979295 chunks)
2021-02-22T11:07:22-05:00: processed 72% (3021213 chunks)
2021-02-22T11:07:22-05:00: processed 73% (3063095 chunks)
2021-02-22T11:07:23-05:00: processed 74% (3104791 chunks)
2021-02-22T11:07:24-05:00: processed 75% (3146395 chunks)
2021-02-22T11:07:24-05:00: processed 76% (3188279 chunks)
2021-02-22T11:07:25-05:00: processed 77% (3230263 chunks)
2021-02-22T11:07:26-05:00: processed 78% (3272270 chunks)
2021-02-22T11:07:27-05:00: processed 79% (3314313 chunks)
2021-02-22T11:07:27-05:00: processed 80% (3356107 chunks)
2021-02-22T11:07:28-05:00: processed 81% (3397912 chunks)
2021-02-22T11:07:28-05:00: processed 82% (3439427 chunks)
2021-02-22T11:07:29-05:00: processed 83% (3481376 chunks)
2021-02-22T11:07:30-05:00: processed 84% (3523088 chunks)
2021-02-22T11:07:31-05:00: processed 85% (3565066 chunks)
2021-02-22T11:07:31-05:00: processed 86% (3607065 chunks)
2021-02-22T11:07:32-05:00: processed 87% (3649019 chunks)
2021-02-22T11:07:32-05:00: processed 88% (3690958 chunks)
2021-02-22T11:07:33-05:00: processed 89% (3733335 chunks)
2021-02-22T11:07:34-05:00: processed 90% (3775447 chunks)
2021-02-22T11:07:34-05:00: processed 91% (3817101 chunks)
2021-02-22T11:07:35-05:00: processed 92% (3859189 chunks)
2021-02-22T11:07:35-05:00: processed 93% (3901421 chunks)
2021-02-22T11:07:36-05:00: processed 94% (3943373 chunks)
2021-02-22T11:07:37-05:00: processed 95% (3985643 chunks)
2021-02-22T11:07:37-05:00: processed 96% (4027378 chunks)
2021-02-22T11:07:38-05:00: processed 97% (4069329 chunks)
2021-02-22T11:07:39-05:00: processed 98% (4111034 chunks)
2021-02-22T11:07:39-05:00: processed 99% (4152904 chunks)
2021-02-22T11:07:42-05:00: Removed garbage: 0 B
2021-02-22T11:07:42-05:00: Removed chunks: 0
2021-02-22T11:07:42-05:00: Original data usage: 263.79 TiB
2021-02-22T11:07:42-05:00: On-Disk usage: 12.26 TiB (4.65%)
2021-02-22T11:07:42-05:00: On-Disk chunks: 4194467
2021-02-22T11:07:42-05:00: Deduplication factor: 21.52
2021-02-22T11:07:42-05:00: Average chunk size: 3.06 MiB
2021-02-22T11:07:42-05:00: TASK OK
 
and when did you remove the snapshots of the host ?
 
ok, and what kind of usage would you expect? the logs look ok thus far.
are you sure all backup snapshots are deleted?

maybe the chunks were able to be mostly deduplicated and are reused by other backups?
 
After updating and rebooting the PBS server and manually running a "garbage collection" right after. It finally showed "Removed garbage" and "Removed Chucks" from the deleted host and data.

Should it have required a reboot before the "garbage collection" actually deleted all the data from the removed host ?

** Side note, the time until full hasn't gone back up to where it was before we tested backing up this data. Will it go backup or reset at some point ?
 
NomadCF said:
Should it have required a reboot before the "garbage collection" actually deleted all the data from the removed host ?
Click to expand...
no it should not have... is there anything special to your disk/datastore setup?

NomadCF said:
** Side note, the time until full hasn't gone back up to where it was before we tested backing up this data. Will it go backup or reset at some point ?
Click to expand...
sorry i do not understand, what do you mean by that?
 
dcsapak said:
no it should not have... is there anything special to your disk/datastore setup?
Click to expand...
It's an old 720xd with a H710 controller and standard SAS disks.


My side note was about the how the "estimated time until full" still reads or predicts that the server will be full as if I still had all that data on the server. We went from 147 days until full to 48 days after our testing the backup-client. Will the "estimated time until full" correct itself ?
 
NomadCF said:
Will the "estimated time until full" correct itself ?
Click to expand...
yes, it simply looks at the usage data of the last 30 days and calculates a simple linear regression, so its only a very rough estimate nothing to worry and only informational
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom