LTO 9 tape for 20TB backup

Nov 21, 2023
8
0
1
Hi Team,

We have a tape library with one tape drive and two LTO9 tape cartridges. Each LTO9 max capacity is 18TB. What happens if a VM exceeds this size (Example: 20TB VM data) needs to be backed up onto tape cartridge? The datastore for backup server is 30TB and no tape changer is available from the backup server.

Expecting the cartridges to autoload the second one into the tape drive on the first one getting full.

Thanks,
Aagi
 
if you use a tape changer/library -> the next available tape will be loaded and the media-set continued
if you use a standalone tape drive -> the backup stalls and sends an email which tape you should insert
 
Hi,

Got an issue with the tape changer, it is not recognized with the command proxmox-tape changer scan.

The storage controller driver is installed and the proxmox-tape drive scan shows the LTO9 drives. Please share your thoughts on this issue.

1701238065738.png



1701238182053.png

Thanks,
Aagi
 
can you post the output of 'dmesg' ?
 
ok it seems the kernel does not see the changer. maybe there is some configuration to be made on it directly (e.g. via a web console) to enable the host seeing the library itself?
what kind of changer is it? how did you connect it to the host? are you sure the HBA does support tape changers (i think not all do, e.g. some raid cards only support tape drives, not changers)
 
Hi Dominik, We installed the latest driver for HBA and got the changer identified. Strangely the load function works to load the tape into drive but unload function throws illegal request. Is there any version compatibility issue for Quantum scalar i3 LTO9 tape library to work?

1702017156497.png
 
Hi Dominik, Thanks a lot. We fixed it. The Quantum tape library GUI required enabling unload permission for hosts to be able to unload the tape cartridges.

Do we always need a datastore of 20TB to backup 20TB of VM data into tape library consisting of 20TB of cartridges?

1702275489045.png
 
Thanks Dominik,

For example: We have a VM data of 100TB to be backed up into the tape cartridges of 18TB each (LTO9). What will be the capacity of datastore in the backup server?

Regards,
Aagi
 
Hi Aagi,

Sorry for interupting. I only have backed up to tape backups from datastore. From the conversation I infer that you try to / want to backup from tape to VM directly, is that correct?

Let me share my (positive :) ) experience backing up to tape from PBS.

In my case, the (incrementally chunked) backups are in their datastores. The datastores (in single digit TBs :p ) have room to spare for future increments; my largest container is just over 2 TB, and spans multiple LTO3 tapes. The mediaset started with four tapes for the first backup, with the last tape hardly touched.

I only have access to tape drives, no changers. When running the tape backup from the GUI, it will pause when a tape is full, stating the ID of the tape in the mediaset that it wants to use next. (Edit - it ejects the tape and waits patiently until I insert the requested tape; if I insert the incorrect tape, it will make some noise, and state that this is not the tape it wants and tells me which tape to insert instead.)

The next few backups would add new and changed chunks in the datastore to the last tape. At some point a backup failed: I had started a backup that contained more incremental snapshots than would fit in the free space on the fourth tape. Instead of pausing the process until a new tape is added to the mediaset, it completes the process with a failure of "mediaset full". After adding a new tape to the mediaset, the failed backup of the last snapshot can be restarted (not continued).

In my experience the tape integration is pretty robust. I started with an external LTO3 drive (over parallel SCSI), and at some point switched to an external LTO4 drive (via SAS). PBS didn't flinch, and continues using the same datasets in the newly assigned drive. I don't plan on mixing tape generations in a single dataset to prevent future headaches in case I need to restore using a different generation drive.

Before starting I hesitated and stumbled at quite a few steps, and did not always make quick progress as many steps in the backup process take more than a day to complete for my setup. I hope you can scale my setup to yours and that this looking-back story gives a bit of an impression of what to expect, apart from the instructions that are more in a forward perspective (as in: this is the command; something will happen after that).

@dcsapak , you have helped me quite a bit in the past; please tell if there are things in my story that are best to avoid or where there are caveats to prevent my trial-and-error process from becoming someone elses best practice where that should not be the case :p
 
Last edited:
For example: We have a VM data of 100TB to be backed up into the tape cartridges of 18TB each (LTO9). What will be the capacity of datastore in the backup server?
as i already (and @wbk said) you cannot directly backup to tape, you first have to backup to a datastore and then to the tape. if a single backup is 100TB in size, your datastore must be able to handle that before you can back it up to tape

@dcsapak , you have helped me quite a bit in the past; please tell if there are things in my story that are best to avoid or where there are caveats to prevent my trial-and-error process from becoming someone elses best practice where that should not be the case :p
seems fine, though
nstead of pausing the process until a new tape is added to the mediaset, it completes the process with a failure of "mediaset full".
this only happens if pbs does not know about any additional tapes, it cannot request one if it's not labeled. so (like described in the docs) you should label all tapes beforehand, then pbs can request a new one if yours are full
 
  • Like
Reactions: wbk
Hi Dominic,

Thank you for your time and reply!

this only happens if pbs does not know about any additional tapes, it cannot request one if it's not labeled. so (like described in the docs) you should label all tapes beforehand, then pbs can request a new one if yours are full

I know; I had hoped it would fit, did not take precautions and learned for the next time ;-)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!