Garbage Collect Jobs

flowbergit

Renowned Member
Jun 3, 2015
42
0
71
After upgrade to proxmox Backup Server 3.3 I've got some fail jobs with status: TASK ERROR: Aborting GC for safety reasons: nested datastores not allowed: 'BACKUP350' already in "/mnt/datastore/BACKUP350".

I know that I have some tenants as a new one datastores inside this but how to resolve it.
 
Forum members would need this info in order to assist.
Some problems are thorny to solve. This is probably not one of those.
I expect you'll get an explicit answer here. Just ... help us help you.

zpool status

zfs list

df -h

cat /etc/proxmox-backup/datastore.cfg


BTW ... do get this fixed. If GC isn't running, your datastore may fill up.
 
Last edited:
Code:
root@backup350:~# df -h
Filesystem            Size  Used Avail Use% Mounted on
udev                   32G     0   32G   0% /dev
tmpfs                 6.3G  4.1M  6.3G   1% /run
rpool/ROOT/pbs-1      900G   42G  858G   5% /
tmpfs                  32G     0   32G   0% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
rpool                 858G  128K  858G   1% /rpool
rpool/ROOT            858G  128K  858G   1% /rpool/ROOT
BACKUP350             267T  114T  154T  43% /mnt/datastore/BACKUP350
BACKUP350/u044228535   94G   85G  9.2G  91% /mnt/datastore/BACKUP350/u044228535
BACKUP350/u302298350  373G   72G  301G  20% /mnt/datastore/BACKUP350/u302298350
BACKUP350/u386916143   94G   65M   94G   1% /mnt/datastore/BACKUP350/u386916143
BACKUP350/u118989474  1.9T  1.4T  448G  76% /mnt/datastore/BACKUP350/u118989474
BACKUP350/POC_GDS     932G  384K  932G   1% /mnt/datastore/BACKUP350/POC_GDS
BACKUP350/u073196258   94G  4.3G   89G   5% /mnt/datastore/BACKUP350/u073196258
BACKUP350/u205127408   94G   65M   94G   1% /mnt/datastore/BACKUP350/u205127408
BACKUP350/u615719492  932G   49G  883G   6% /mnt/datastore/BACKUP350/u615719492
BACKUP350/u417906176   94G   65M   94G   1% /mnt/datastore/BACKUP350/u417906176
BACKUP350/u824497261  280G  217G   64G  78% /mnt/datastore/BACKUP350/u824497261
BACKUP350/u352717488  280G  280G     0 100% /mnt/datastore/BACKUP350/u352717488
BACKUP350/u450323955   94G   94G     0 100% /mnt/datastore/BACKUP350/u450323955
BACKUP350/u541983027  187G  187G     0 100% /mnt/datastore/BACKUP350/u541983027
BACKUP350/u732816845  932G  630G  302G  68% /mnt/datastore/BACKUP350/u732816845
BACKUP350/u635995932   94G   60G   35G  64% /mnt/datastore/BACKUP350/u635995932
BACKUP350/u402549110  5.5T  5.5T     0 100% /mnt/datastore/BACKUP350/u402549110
tmpfs                 6.3G     0  6.3G   0% /run/user/0
root@backup350:~# zpool status
  pool: BACKUP350
 state: ONLINE
  scan: scrub repaired 0B in 2 days 18:24:59 with 0 errors on Tue Dec 10 18:49:00 2024
config:

        NAME                        STATE     READ WRITE CKSUM
        BACKUP350                   ONLINE       0     0     0
          raidz2-0                  ONLINE       0     0     0
            wwn-0x5000c50094c3c547  ONLINE       0     0     0
            wwn-0x5000c50094ad0d5b  ONLINE       0     0     0
            wwn-0x5000c50094b6ec63  ONLINE       0     0     0
            wwn-0x5000c50094b6eb23  ONLINE       0     0     0
            wwn-0x5000c50094c3aceb  ONLINE       0     0     0
            wwn-0x5000c50094c3a54f  ONLINE       0     0     0
            wwn-0x5000c50094b6de13  ONLINE       0     0     0
            wwn-0x5000c50094b2a1ef  ONLINE       0     0     0
            wwn-0x5000c50094a7967b  ONLINE       0     0     0
            wwn-0x5000c50094b6e3ab  ONLINE       0     0     0
            wwn-0x5000c50094c3ad57  ONLINE       0     0     0
            wwn-0x5000c50094b6c397  ONLINE       0     0     0
            wwn-0x5000c50094c3ad83  ONLINE       0     0     0
            wwn-0x5000c50094c39ed3  ONLINE       0     0     0
            wwn-0x5000c50094c3b0a3  ONLINE       0     0     0
            wwn-0x5000c50094c3b0eb  ONLINE       0     0     0
            wwn-0x5000c5009441982b  ONLINE       0     0     0
            wwn-0x5000c50094b6d99f  ONLINE       0     0     0
            wwn-0x5000c50094b6901f  ONLINE       0     0     0
            wwn-0x5000c50094b6e8e7  ONLINE       0     0     0
            wwn-0x5000c50094b29d13  ONLINE       0     0     0
            wwn-0x5000c50086b1c11b  ONLINE       0     0     0
            wwn-0x5000c50094b6e8a3  ONLINE       0     0     0
            wwn-0x5000c50094c39fc3  ONLINE       0     0     0
            wwn-0x5000c50094c3bd37  ONLINE       0     0     0
            wwn-0x5000c50094c3c12b  ONLINE       0     0     0
            wwn-0x5000c50094b6cdb3  ONLINE       0     0     0
            wwn-0x5000c50094c3ac43  ONLINE       0     0     0
            wwn-0x5000c50094c3c597  ONLINE       0     0     0
            wwn-0x5000c50094b27e37  ONLINE       0     0     0
            wwn-0x5000c50094c3c38f  ONLINE       0     0     0
            wwn-0x5000c50094b6e7ef  ONLINE       0     0     0
            wwn-0x5000c50094b6e587  ONLINE       0     0     0
            wwn-0x5000c50094c3b027  ONLINE       0     0     0

errors: No known data errors

  pool: rpool
 state: ONLINE
  scan: scrub repaired 0B in 00:02:14 with 0 errors on Sun Dec  8 00:26:21 2024
config:

        NAME                                                   STATE     READ WRITE CKSUM
        rpool                                                  ONLINE       0     0     0
          mirror-0                                             ONLINE       0     0     0
            ata-Samsung_SSD_870_EVO_1TB_S75CNX0W927499K-part3  ONLINE       0     0     0
            ata-Samsung_SSD_870_EVO_1TB_S75CNX0W926993E-part3  ONLINE       0     0     0

errors: No known data errors
root@backup350:~# zfs list
NAME                   USED  AVAIL  REFER  MOUNTPOINT
BACKUP350              122T   153T   113T  /mnt/datastore/BACKUP350
BACKUP350/POC      277K   931G   277K  /mnt/datastore/BACKUP350/POC
BACKUP350/u044228535  84.0G  9.12G  84.0G  /mnt/datastore/BACKUP350/u044228535
BACKUP350/u073196258  4.22G  88.9G  4.22G  /mnt/datastore/BACKUP350/u073196258
BACKUP350/u118989474  1.38T   447G  1.38T  /mnt/datastore/BACKUP350/u118989474
BACKUP350/u205127408  64.5M  93.1G  64.5M  /mnt/datastore/BACKUP350/u205127408
BACKUP350/u302298350  71.6G   301G  71.6G  /mnt/datastore/BACKUP350/u302298350
BACKUP350/u352717488   279G     0B   279G  /mnt/datastore/BACKUP350/u352717488
BACKUP350/u386916143  64.5M  93.1G  64.5M  /mnt/datastore/BACKUP350/u386916143
BACKUP350/u402549110  5.46T     0B  5.46T  /mnt/datastore/BACKUP350/u402549110
BACKUP350/u417906176  64.5M  93.1G  64.5M  /mnt/datastore/BACKUP350/u417906176
BACKUP350/u450323955  93.1G     0B  93.1G  /mnt/datastore/BACKUP350/u450323955
BACKUP350/u541983027   186G     0B   186G  /mnt/datastore/BACKUP350/u541983027
BACKUP350/u615719492  48.4G   883G  48.4G  /mnt/datastore/BACKUP350/u615719492
BACKUP350/u635995932  59.1G  34.0G  59.1G  /mnt/datastore/BACKUP350/u635995932
BACKUP350/u732816845   630G   302G   630G  /mnt/datastore/BACKUP350/u732816845
BACKUP350/u824497261   216G  63.1G   216G  /mnt/datastore/BACKUP350/u824497261
rpool                 41.6G   858G    96K  /rpool
rpool/ROOT            41.5G   858G    96K  /rpool/ROOT
rpool/ROOT/pbs-1      41.5G   858G  41.5G  /
root@backup350:~# cat /etc/proxmox-backup/datastore.cfg
datastore: BACKUP350
        path /mnt/datastore/BACKUP350

datastore: u352717488
        gc-schedule 14:00
        path /mnt/datastore/BACKUP350/u352717488

datastore: u635995932
        gc-schedule *:0/30
        path /mnt/datastore/BACKUP350/u635995932

datastore: u824497261
        gc-schedule sat 18:15
        path /mnt/datastore/BACKUP350/u824497261

datastore: u044228535
        gc-schedule 18:00
        path /mnt/datastore/BACKUP350/u044228535
        verify-new true

datastore: u450323955
        path /mnt/datastore/BACKUP350/u450323955

datastore: u402549110
        gc-schedule daily
        path /mnt/datastore/BACKUP350/u402549110

datastore: u386916143
        path /mnt/datastore/BACKUP350/u386916143

datastore: u205127408
        path /mnt/datastore/BACKUP350/u205127408

datastore: u615719492
        gc-schedule hourly
        path /mnt/datastore/BACKUP350/u615719492

datastore: u732816845
        gc-schedule 0/3:00
        path /mnt/datastore/BACKUP350/u732816845

datastore: u541983027
        path /mnt/datastore/BACKUP350/u541983027

datastore: u118989474
        gc-schedule sat 18:15
        path /mnt/datastore/BACKUP350/u118989474
        verify-new true

datastore: u073196258
        gc-schedule 0/3:00
        path /mnt/datastore/BACKUP350/u073196258

datastore: u302298350
        gc-schedule 0/3:00
        path /mnt/datastore/BACKUP350/u302298350

datastore: u417906176
        path /mnt/datastore/BACKUP350/u417906176
 
you have nested datastores, which is not supported. PBS recently got upgraded to detect and warn this.

datastore: BACKUP350

move that datastore to another location if it is used, or remove it if it isn't..
 
  • Like
Reactions: Johannes S
Let me try rephrasing that.


This bit encapsulates all the following bits.

datastore: BACKUP350
path /mnt/datastore/BACKUP350


See? The next one is inside it.

datastore: u352717488
gc-schedule 14:00
path /mnt/datastore/BACKUP350/u352717488


So your problem is that first one.
If you don't have to mount that, then remove it.
If you do need to backup stuff to that root directory ... well, like fabian said, you need to move it.
 
Last edited:
  • Like
Reactions: Johannes S

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!