Hello! Late last year I decided to finally switch my windows server to Proxmox. Before the switch, I had two hdd formatted as ntfs and setup as raid with "intel rapid storage technology" with all my photos and videos. When I switched I decided to not immediately erase the old drive but instead made a full copy to a separated third drive that I have been running on to try Proxmox before I finally make the switch and plug in and erase the old drives. I have currently formatted the drive as zfs and pass it to a lxc with the following command
mp0: /TestStorage/data,mp=/mnt/data
This works great and has the advantage that my Immich container can access the photos on the drive directly as well with a simmilar mp command (yes I know that I could connect it to a smb share). Another thing I like about this is that, if I for some reason, ever decide to switch from Proxmox, the drive will work without issues on any linux pc.
However, I recently began using PBS. Since I have added a mount point to a lxc I can't backup the drive directly from the Proxmox gui and must instead use proxmox-backup-client inside the lxc. This is not really a issue and I could easily automate it with cron. The issue is however that it's sooooooooo slow when it needs to check which files has been changed and need to be updated. My drive is a 4 tb hdd but I only have 2.5 tb of data on it. For example I ran a backup command when the PBS backup was "up to date" and had a read/write of roughly 30 Mbyte/s. Doing some napkin math this means that the backup will take allmost 24 hours to run even though no new files will be sent to PBS.
I now feal ready to format my old drive and set them up as a zfs raid (mirror) but am wondering how I should best set them up?? I could do like I have done now with a mount point but just run the backup every 3-4 week instead or try changning the detection mode to metadata and see if that speeds it up. Alterentivly I could create a mount point in the gui so that it createas a container volume. Would this speed up the backups? Will proxmox then allways know what files has changed or will it have to look through all the files again?
So how would you recommend that I set it up so that it works best with PBS? Thanks
mp0: /TestStorage/data,mp=/mnt/data
This works great and has the advantage that my Immich container can access the photos on the drive directly as well with a simmilar mp command (yes I know that I could connect it to a smb share). Another thing I like about this is that, if I for some reason, ever decide to switch from Proxmox, the drive will work without issues on any linux pc.
However, I recently began using PBS. Since I have added a mount point to a lxc I can't backup the drive directly from the Proxmox gui and must instead use proxmox-backup-client inside the lxc. This is not really a issue and I could easily automate it with cron. The issue is however that it's sooooooooo slow when it needs to check which files has been changed and need to be updated. My drive is a 4 tb hdd but I only have 2.5 tb of data on it. For example I ran a backup command when the PBS backup was "up to date" and had a read/write of roughly 30 Mbyte/s. Doing some napkin math this means that the backup will take allmost 24 hours to run even though no new files will be sent to PBS.
I now feal ready to format my old drive and set them up as a zfs raid (mirror) but am wondering how I should best set them up?? I could do like I have done now with a mount point but just run the backup every 3-4 week instead or try changning the detection mode to metadata and see if that speeds it up. Alterentivly I could create a mount point in the gui so that it createas a container volume. Would this speed up the backups? Will proxmox then allways know what files has changed or will it have to look through all the files again?
So how would you recommend that I set it up so that it works best with PBS? Thanks