[SOLVED] Outsource ns directory of datastore

[kokel]

Hello,

I thought it's a good idea to outsource the datastore ns directory to a faster storage and work with a symlink.

Everythink seems fine until GC is started. The 1st phase was skipped or way too fast and 1-2 days later GC deleted all? or most valid chunks of my backups I wanted too keep.

So I have rolled back.

Is there a way too store the ns directory on a faster storage without breaking GC?

Thanks

 

[Lukas Wagner]

I guess you could (bind)-mount the faster driver to this directory. I have not tried this myself, but I think that should work. Did you see any speed improvements from the symlink approach? IIRC the ns directory only contains snapshot metadata.

 

[kokel]

Hi @Lukas Wagner ,

It's the offsite backup server with cheap HDDs for the datastore, but the system has 2 nvmes. Navigating in the datastore, the time to show all backups of a NS was much faster, especially while sync or verify jobs were running.

With the bind mount it seems to work. GC phase1 wasn't skipped.

Thanks!

 

[Lukas Wagner]

That's good to hear. Please mark the thread as solved, that makes it easier for others for find the solution if they have a similar problem. You can do so by editing the thread and selecting the 'solved' prefix right in front of the subject line!

Thanks!

 

[Vicente Filho]

To store the ns directory on faster storage without disrupting the garbage collection (GC) process, you can try using a different approach. Instead of a direct symlink, consider setting up a dedicated storage solution that is both fast and stable. Ensure that the storage solution is optimized for handling metadata, as this will prevent the GC from skipping critical phases. You might also need to fine-tune your GC settings to account for the new storage environment, ensuring that it properly tracks and retains your backups.

For more comprehensive support, especially if you are dealing with complex or large-scale data management, exploring insurance BPO services could be beneficial. These services offer specialized back-office outsourcing solutions that can optimize your data storage, management, and retrieval processes, ensuring that everything runs smoothly without the risk of data loss.