Automatic Garbage collector error on delete backup.

Dark26 · Sep 3, 2020

Bonjour,

I have this message on the task list :


2020-09-03T00:00:00+02:00: starting garbage collection on store Backup_Day
2020-09-03T00:00:00+02:00: task triggered by schedule 'daily'
2020-09-03T00:00:00+02:00: Start GC phase1 (mark used chunks)
2020-09-03T00:00:09+02:00: TASK ERROR: Unable to open dynamic index "/Backup_Day/ct/198/2020-08-26T01:00:04Z/root.pxar.didx" - No such file or directory (os error 2)

Indeed, the backup doesn't exist , i delete it to make space. ( i think i did it in the pbs interface, not in the pve interface )

But if i run in manual it's work :


2020-09-03T10:26:48+02:00: starting garbage collection on store Backup_Day
2020-09-03T10:26:48+02:00: Start GC phase1 (mark used chunks)
2020-09-03T10:27:11+02:00: Start GC phase2 (sweep unused chunks)
2020-09-03T10:27:11+02:00: 1%, processed 208 chunks
2020-09-03T10:27:11+02:00: 2%, processed 417 chunks
2020-09-03T10:27:11+02:00: 3%, processed 619 chunks
2020-09-03T10:27:11+02:00: 4%, processed 803 chunks
2020-09-03T10:27:11+02:00: 5%, processed 1009 chunks
2020-09-03T10:27:11+02:00: 6%, processed 1197 chunks
2020-09-03T10:27:11+02:00: 7%, processed 1419 chunks
2020-09-03T10:27:11+02:00: 8%, processed 1624 chunks
2020-09-03T10:27:11+02:00: 9%, processed 1857 chunks
2020-09-03T10:27:11+02:00: 10%, processed 2059 chunks
2020-09-03T10:27:11+02:00: 11%, processed 2263 chunks
2020-09-03T10:27:11+02:00: 12%, processed 2453 chunks
2020-09-03T10:27:11+02:00: 13%, processed 2643 chunks
2020-09-03T10:27:12+02:00: 14%, processed 2832 chunks
2020-09-03T10:27:12+02:00: 15%, processed 3054 chunks
2020-09-03T10:27:12+02:00: 16%, processed 3290 chunks
2020-09-03T10:27:12+02:00: 17%, processed 3531 chunks
2020-09-03T10:27:12+02:00: 18%, processed 3742 chunks
2020-09-03T10:27:12+02:00: 19%, processed 3947 chunks
2020-09-03T10:27:12+02:00: 20%, processed 4164 chunks
2020-09-03T10:27:12+02:00: 21%, processed 4384 chunks
2020-09-03T10:27:12+02:00: 22%, processed 4589 chunks
2020-09-03T10:27:12+02:00: 23%, processed 4793 chunks
2020-09-03T10:27:12+02:00: 24%, processed 5002 chunks
2020-09-03T10:27:12+02:00: 25%, processed 5211 chunks
2020-09-03T10:27:12+02:00: 26%, processed 5414 chunks
2020-09-03T10:27:12+02:00: 27%, processed 5603 chunks
2020-09-03T10:27:12+02:00: 28%, processed 5803 chunks
2020-09-03T10:27:12+02:00: 29%, processed 6005 chunks
2020-09-03T10:27:12+02:00: 30%, processed 6208 chunks
2020-09-03T10:27:12+02:00: 31%, processed 6421 chunks
2020-09-03T10:27:12+02:00: 32%, processed 6666 chunks
2020-09-03T10:27:12+02:00: 33%, processed 6912 chunks
2020-09-03T10:27:12+02:00: 34%, processed 7127 chunks
2020-09-03T10:27:12+02:00: 35%, processed 7313 chunks
2020-09-03T10:27:12+02:00: 36%, processed 7524 chunks
2020-09-03T10:27:12+02:00: 37%, processed 7735 chunks
2020-09-03T10:27:12+02:00: 38%, processed 7926 chunks
2020-09-03T10:27:12+02:00: 39%, processed 8148 chunks
2020-09-03T10:27:13+02:00: 40%, processed 8370 chunks
2020-09-03T10:27:13+02:00: 41%, processed 8575 chunks
2020-09-03T10:27:13+02:00: 42%, processed 8824 chunks
2020-09-03T10:27:13+02:00: 43%, processed 9064 chunks
2020-09-03T10:27:13+02:00: 44%, processed 9269 chunks
2020-09-03T10:27:13+02:00: 45%, processed 9463 chunks
2020-09-03T10:27:13+02:00: 46%, processed 9676 chunks
2020-09-03T10:27:13+02:00: 47%, processed 9888 chunks
2020-09-03T10:27:13+02:00: 48%, processed 10103 chunks
2020-09-03T10:27:13+02:00: 49%, processed 10325 chunks
2020-09-03T10:27:13+02:00: 50%, processed 10537 chunks
2020-09-03T10:27:13+02:00: 51%, processed 10748 chunks
2020-09-03T10:27:13+02:00: 52%, processed 10966 chunks
2020-09-03T10:27:13+02:00: 53%, processed 11186 chunks
2020-09-03T10:27:13+02:00: 54%, processed 11383 chunks
2020-09-03T10:27:13+02:00: 55%, processed 11589 chunks
2020-09-03T10:27:14+02:00: 56%, processed 11791 chunks
2020-09-03T10:27:14+02:00: 57%, processed 11982 chunks
2020-09-03T10:27:14+02:00: 58%, processed 12186 chunks
2020-09-03T10:27:14+02:00: 59%, processed 12396 chunks
2020-09-03T10:27:14+02:00: 60%, processed 12579 chunks
2020-09-03T10:27:14+02:00: 61%, processed 12791 chunks
2020-09-03T10:27:14+02:00: 62%, processed 12999 chunks
2020-09-03T10:27:14+02:00: 63%, processed 13188 chunks
2020-09-03T10:27:14+02:00: 64%, processed 13398 chunks
2020-09-03T10:27:14+02:00: 65%, processed 13599 chunks
2020-09-03T10:27:14+02:00: 66%, processed 13837 chunks
2020-09-03T10:27:14+02:00: 67%, processed 14052 chunks
2020-09-03T10:27:14+02:00: 68%, processed 14253 chunks
2020-09-03T10:27:14+02:00: 69%, processed 14477 chunks
2020-09-03T10:27:14+02:00: 70%, processed 14686 chunks
2020-09-03T10:27:14+02:00: 71%, processed 14884 chunks
2020-09-03T10:27:14+02:00: 72%, processed 15074 chunks
2020-09-03T10:27:14+02:00: 73%, processed 15284 chunks
2020-09-03T10:27:14+02:00: 74%, processed 15501 chunks
2020-09-03T10:27:15+02:00: 75%, processed 15689 chunks
2020-09-03T10:27:15+02:00: 76%, processed 15903 chunks
2020-09-03T10:27:15+02:00: 77%, processed 16115 chunks
2020-09-03T10:27:15+02:00: 78%, processed 16350 chunks
2020-09-03T10:27:15+02:00: 79%, processed 16578 chunks
2020-09-03T10:27:15+02:00: 80%, processed 16809 chunks
2020-09-03T10:27:15+02:00: 81%, processed 17020 chunks
2020-09-03T10:27:15+02:00: 82%, processed 17221 chunks
2020-09-03T10:27:15+02:00: 83%, processed 17429 chunks
2020-09-03T10:27:15+02:00: 84%, processed 17660 chunks
2020-09-03T10:27:15+02:00: 85%, processed 17855 chunks
2020-09-03T10:27:15+02:00: 86%, processed 18050 chunks
2020-09-03T10:27:15+02:00: 87%, processed 18254 chunks
2020-09-03T10:27:15+02:00: 88%, processed 18427 chunks
2020-09-03T10:27:15+02:00: 89%, processed 18631 chunks
2020-09-03T10:27:15+02:00: 90%, processed 18863 chunks
2020-09-03T10:27:15+02:00: 91%, processed 19073 chunks
2020-09-03T10:27:15+02:00: 92%, processed 19280 chunks
2020-09-03T10:27:15+02:00: 93%, processed 19490 chunks
2020-09-03T10:27:15+02:00: 94%, processed 19711 chunks
2020-09-03T10:27:15+02:00: 95%, processed 19898 chunks
2020-09-03T10:27:15+02:00: 96%, processed 20106 chunks
2020-09-03T10:27:15+02:00: 97%, processed 20317 chunks
2020-09-03T10:27:15+02:00: 98%, processed 20507 chunks
2020-09-03T10:27:16+02:00: 99%, processed 20721 chunks
2020-09-03T10:27:16+02:00: Removed garbage: 3.74 GiB
2020-09-03T10:27:16+02:00: Removed chunks: 2240
2020-09-03T10:27:16+02:00: Original data usage: 170.01 GiB
2020-09-03T10:27:16+02:00: On-Disk usage: 29.91 GiB (17.59%)
2020-09-03T10:27:16+02:00: On-Disk chunks: 18683
2020-09-03T10:27:16+02:00: Average chunk size: 1.64 MiB
2020-09-03T10:27:16+02:00: TASK OK

Stefan_R · Sep 3, 2020

Dark26 said:
I have this message on the task list :

Did the message appear again? You might have just ran into a race where you deleted it just as the GC was starting. Couldn't think of anything else, the automatic and manual GC use the same code internally...

If it happens again let me know, I'll take a look either way.

Dark26 · Sep 3, 2020

I will tell if the problem appears tommorow or if i can reproduce it.

danielb · Sep 3, 2020

Also had this error, quite easy to reproduce if you set the same schedule for pruning and gc on a datastore (eg, "daily" for both)

Dark26 · Sep 4, 2020

danielb said:
Aldo had this error, quite easy to reproduce if you set the same schedule for pruning and gc on a datastore (eg, "daily" for both)

i have this option too ( daily both )

Maybe possible to set a différent time between the 2 tasks when the same schedule is set.

fabian · Sep 4, 2020

this is definitely a bug, I'll take a look.

Search

Search

Automatic Garbage collector error on delete backup.

Dark26

Well-Known Member

Stefan_R

Proxmox Retired Staff

Dark26

Well-Known Member

danielb

Renowned Member

Dark26

Well-Known Member

fabian

Proxmox Staff Member