I'm relatively new to pve and pbs, but I've been using them in my homelab for about a month. I've successfully set up pve and pbs on separate machines and pve is working smoothly with about 10 cts running. When I try to run a backup in pve (with my pbs storage location), I get an error. Below I've posted a brief explanation of my set-up and the task output of the failed backup.
Setup details
PBS
- storage access: SMB share from file server in priveleged container on pve host (16TB HDD)
- pbs datastore: mounted SMB share to PBS (via cifs-utils and /etc/fstab) and pointed datastore to share
- successfully gave write permissions to pbs and created .chunk file on the HDD
- storage shows as configured on pbs
- created a pbs local user (garrett@pbs) and added as admin/datastore poweruser
PVE
- added Proxmox Backup Server storage from Datacenter named "pbs" using login of local PBS user
- added a pve local user (garrett@pve) to run the backup (saw in a different thread that this was necessary)
Error
- when I use the GUI to create a Backup from within a CT (ID=100 in this case) I get the following log:
INFO: starting new backup job: vzdump 100 --notification-mode auto --node pve1 --remove 0 --storage pbs --mode snapshot --notes-template '{{guestname}}'
INFO: Starting Backup of VM 100 (lxc)
INFO: Backup started at 2024-01-15 08:41:06
INFO: status = running
INFO: CT Name: piholedns
INFO: including mount point rootfs ('/') in backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: create storage snapshot 'vzdump'
INFO: creating Proxmox Backup Server archive 'ct/100/2024-01-15T15:41:06Z'
INFO: run: lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup --crypt-mode=none pct.conf:/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --skip-lost-and-found --exclude=/tmp/?* --exclude=/var/tmp/?* --exclude=/var/run/?*.pid --backup-type ct --backup-id 100 --backup-time 1705333266 --repository garrett@pbs@10.10.3.4
bs_backup
INFO: Starting backup: ct/100/2024-01-15T15:41:06Z
INFO: Client name: pve1
INFO: Starting backup protocol: Mon Jan 15 08:41:06 2024
INFO: No previous manifest available.
INFO: Upload config file '/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf' to 'garrett@pbs@10.10.3.4:8007bs_backup' as pct.conf.blob
INFO: Error: fchmod "/mnt/pvebackup/ct/100/2024-01-15T15:41:06Z/pct.conf.tmp_FVmvm7" failed: EPERM: Operation not permitted
INFO: cleanup temporary 'vzdump' snapshot
ERROR: Backup of VM 100 failed - command 'lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup '--crypt-mode=none' pct.conf:/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --skip-lost-and-found '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' --backup-type ct --backup-id 100 --backup-time 1705333266 --repository garrett@pbs@10.10.3.4bs_backup' failed: exit code 255
INFO: Failed at 2024-01-15 08:41:06
INFO: Backup job finished with errors
INFO: notified via target `mail-to-root`
TASK ERROR: job errors
At this point, I'm just scratching my head. It seemed like permissions issues I had earlier were solved by making the CT with the SMB share privileged. This allowed me to mount my backup drive to pbs from the share and everything in pbs looks right. I'm even able to add pbs as storage in the Datacenter on PVE and it shows up as the storage for backups in CT's, but I'm not sure what is throwing the error.
When I first got the error, I gleaned from other threads that it might be the lack of local users on both machines causing the issue, but trying to create local users and giving them write permissions for storage and backups did not solve the issue. I've tried every combination of logins on both machines (root on pve and local on pbs, vice versa, and root on both as well as local on both).
Any help is appreciated!
Setup details
PBS
- storage access: SMB share from file server in priveleged container on pve host (16TB HDD)
- pbs datastore: mounted SMB share to PBS (via cifs-utils and /etc/fstab) and pointed datastore to share
- successfully gave write permissions to pbs and created .chunk file on the HDD
- storage shows as configured on pbs
- created a pbs local user (garrett@pbs) and added as admin/datastore poweruser
PVE
- added Proxmox Backup Server storage from Datacenter named "pbs" using login of local PBS user
- added a pve local user (garrett@pve) to run the backup (saw in a different thread that this was necessary)
Error
- when I use the GUI to create a Backup from within a CT (ID=100 in this case) I get the following log:
INFO: starting new backup job: vzdump 100 --notification-mode auto --node pve1 --remove 0 --storage pbs --mode snapshot --notes-template '{{guestname}}'
INFO: Starting Backup of VM 100 (lxc)
INFO: Backup started at 2024-01-15 08:41:06
INFO: status = running
INFO: CT Name: piholedns
INFO: including mount point rootfs ('/') in backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: create storage snapshot 'vzdump'
INFO: creating Proxmox Backup Server archive 'ct/100/2024-01-15T15:41:06Z'
INFO: run: lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup --crypt-mode=none pct.conf:/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --skip-lost-and-found --exclude=/tmp/?* --exclude=/var/tmp/?* --exclude=/var/run/?*.pid --backup-type ct --backup-id 100 --backup-time 1705333266 --repository garrett@pbs@10.10.3.4
bs_backupINFO: Starting backup: ct/100/2024-01-15T15:41:06Z
INFO: Client name: pve1
INFO: Starting backup protocol: Mon Jan 15 08:41:06 2024
INFO: No previous manifest available.
INFO: Upload config file '/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf' to 'garrett@pbs@10.10.3.4:8007
bs_backup' as pct.conf.blobINFO: Error: fchmod "/mnt/pvebackup/ct/100/2024-01-15T15:41:06Z/pct.conf.tmp_FVmvm7" failed: EPERM: Operation not permitted
INFO: cleanup temporary 'vzdump' snapshot
ERROR: Backup of VM 100 failed - command 'lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup '--crypt-mode=none' pct.conf:/var/tmp/vzdumptmp1085686_100/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --skip-lost-and-found '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' --backup-type ct --backup-id 100 --backup-time 1705333266 --repository garrett@pbs@10.10.3.4
bs_backup' failed: exit code 255INFO: Failed at 2024-01-15 08:41:06
INFO: Backup job finished with errors
INFO: notified via target `mail-to-root`
TASK ERROR: job errors
At this point, I'm just scratching my head. It seemed like permissions issues I had earlier were solved by making the CT with the SMB share privileged. This allowed me to mount my backup drive to pbs from the share and everything in pbs looks right. I'm even able to add pbs as storage in the Datacenter on PVE and it shows up as the storage for backups in CT's, but I'm not sure what is throwing the error.
When I first got the error, I gleaned from other threads that it might be the lack of local users on both machines causing the issue, but trying to create local users and giving them write permissions for storage and backups did not solve the issue. I've tried every combination of logins on both machines (root on pve and local on pbs, vice versa, and root on both as well as local on both).
Any help is appreciated!
Last edited: