Proxmox - VM Proxmox Backup 100Tb

[lemen]

Hello,

I have the following scenario. A proxmox server with 12 disk > 10TB , I want to set up a raid 5 of approximately 100TB and set up a machine with proxmox backup inside this proxmox and assign that volume to it. How do you advise me to do it and not corrupt the volume, what would be the format, raw, qcow2, vmdk? xfs?ext4? If you can help me manage this large capacity volume in the most optimal way.

Thank you

 

[intrax]

Make it a raid-z or z2 and use ext4, xfs or btrfs for backup....

 

[gfngfn256]

Just off the top of my head - if you have to run PBS as a VM within PVE (unadvisable I think - but the choice is yours) - I think you should get an HBA card that controls 10 disks (so 100TB total) and passthrough the HBA controller to the PBS VM. That way you will segregate your backups from your PVE, so you can easily retrieve them even if PVE goes belly up.

Imagine the scenario; PVE needs fresh reinstalling & your PBS backups are within the same data pool / disk raid array as original PVE host - nightmare I think.

 

[VictorSTS]

Is that same server the PVE that runs your production VMs or they run on different host(s)? I mean, is that server dedicated to PBS?
Which disk controller does it have (HBA, RAID)?

 

[lemen]

I have the machines in different places, virtualizing it is in case I have to urgently restore something on that same machine. A priori it will only be with the pbs.

We have it as a RAID controller.

 

[VictorSTS]

Although I speak spanish this an english forum

Use the smallest stripe size possible in the RAID configuration to reduce read/write amplification for PBS workloads. Then install PVE using LVM (default) in that host and then PBS alongside it (add the repos and apt install proxmox-backup-server [1]). You can't use ZFS + special device with a RAID controller [2], so your PBS disk performance will be limited no matter which filesystem you use.

Make backups of /etc/proxmox-backup to some other server just in case that host breaks or you reinstall it.

[1] https://pbs.proxmox.com/docs/installation.html#install-proxmox-backup-server-on-proxmox-ve
[2] https://pbs.proxmox.com/docs/installation.html#recommended-server-system-requirements

 

[Kingneutron]

RAID5 is dead for well over a decade. You want 100TB with a single disk redundancy? That is just crazy.

https://www.zdnet.com/article/why-raid-5-stops-working-in-2009/

RAIDZ2 minimum, and you better have backups. Look into tape if you don't want to spend 2x the money on disk storage.

 

[lemen]

Aunque hablo español este es un foro en inglés.

Utilice el tamaño de banda más pequeño posible en la configuración RAID para reducir la amplificación de lectura/escritura para cargas de trabajo de PBS. Luego instale PVE usando LVM (predeterminado) en ese host y luego PBS junto a él (agrege los repositorios y apt install proxmox-backup-server[1]). No puede usar un dispositivo especial ZFS + con un controlador RAID [2], por lo que el rendimiento de su disco PBS será limitado sin importar qué sistema de archivos utilice.

Realice copias de seguridad de /etc/proxmox-backup en algún otro servidor en caso de que el host falle o lo reinstale.

[1] https://pbs.proxmox.com/docs/installation.html#install-proxmox-backup-server-on-proxmox-ve
[2] https://pbs.proxmox.com/docs/installation.html#recommended-server-system-requirements

Sorry for writing in Spanish, I missed it.

I'm going to try the option of installing pbs directly in pve and throwing it as @reyneutron says with raidz2. We have more copies of these machines. It's just one more.
Thanks for your help. I'll tell you when I have it