Backup of VM xxx failed - command '/usr/bin/proxmox-backup-client backup '--crypt-mode=none' pct.conf:/var/tmp/vzdumptmp3948501_900/etc/vzdump/pct.con

[lemonbiter]

Hi there
I am a total newbie to PM and also a newbie to PBS. I installed Proxmox at home on a the latest NUK 13th generation. I am very happy with the overall functionality and learning on a dayly basis.
In my company I setup the PBS as a VM. After setting it up I was able to make my first backup to the PBS with no issues. But just the next day , when I tried the same job for the second (and third, fourth... 39th) time, it pemanently failed. While in progress, PBS shows the job as incoming


PBS Dashboard show in the Dasboard the running task and the protocoll (see below the protocol of the Proxmox at home)

Here is what I get as message from my Proxmox at home:
====================
INFO: starting new backup job: vzdump 900 --notes-template '{{guestname}}' --all 0 --mode suspend --mailnotification always --node proxmox --storage PBSDINAX
INFO: Starting Backup of VM 900 (lxc)
INFO: Backup started at 2023-09-03 20:43:31
INFO: status = running
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: CT Name: frankenstein3
INFO: including mount point rootfs ('/') in backup
INFO: excluding bind mount point mp0 ('/data') from backup (not a volume)
INFO: starting first sync /proc/3462869/root/ to /var/tmp/vzdumptmp3948501_900
INFO: first sync finished - transferred 916.42M bytes in 3s
INFO: suspending guest
INFO: starting final sync /proc/3462869/root/ to /var/tmp/vzdumptmp3948501_900
INFO: final sync finished - transferred 0 bytes in 0s
INFO: resuming guest
INFO: guest is online again after <1 seconds
INFO: creating Proxmox Backup Server archive 'ct/900/2023-09-03T18:43:31Z'
INFO: run: /usr/bin/proxmox-backup-client backup --crypt-mode=none pct.conf:/var/tmp/vzdumptmp3948501_900/etc/vzdump/pct.conf root.pxar:/var/tmp/vzdumptmp3948501_900 --include-dev /var/tmp/vzdumptmp3948501_900/. --skip-lost-and-found --exclude=/tmp/?* --exclude=/var/tmp/?* --exclude=/var/run/?*.pid --backup-type ct --backup-id 900 --backup-time 1693766611 --repository root@pam@10.0.1.7roxmoxBackupQNAPDINAX
INFO: Starting backup: ct/900/2023-09-03T18:43:31Z
INFO: Client name: proxmox
INFO: Starting backup protocol: Sun Sep 3 20:43:34 2023
INFO: Downloading previous manifest (Tue Aug 29 22:11:29 2023)
INFO: Upload config file '/var/tmp/vzdumptmp3948501_900/etc/vzdump/pct.conf' to 'root@pam@10.0.1.7:8007roxmoxBackupQNAPDINAX' as pct.conf.blob
INFO: Upload directory '/var/tmp/vzdumptmp3948501_900' to 'root@pam@10.0.1.7:8007roxmoxBackupQNAPDINAX' as root.pxar.didx
INFO: HTTP/2.0 connection failed
INFO: catalog upload error - channel closed
INFO: Error: stream closed because of a broken pipe
ERROR: Backup of VM 900 failed - command '/usr/bin/proxmox-backup-client backup '--crypt-mode=none' pct.conf:/var/tmp/vzdumptmp3948501_900/etc/vzdump/pct.conf root.pxar:/var/tmp/vzdumptmp3948501_900 --include-dev /var/tmp/vzdumptmp3948501_900/. --skip-lost-and-found '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' --backup-type ct --backup-id 900 --backup-time 1693766611 --repository root@pam@10.0.1.7roxmoxBackupQNAPDINAX' failed: exit code 255
INFO: Failed at 2023-09-03 20:59:48
INFO: Backup job finished with errors
TASK ERROR: job errors
====================
PBS says:
====================
2023-09-03T20:43:34+02:00: starting new backup on datastore 'ProxmoxBackupQNAPDINAX': "ct/900/2023-09-03T18:43:31Z"
2023-09-03T20:43:34+02:00: protocol upgrade done
2023-09-03T20:43:34+02:00: GET /previous_backup_time
2023-09-03T20:43:34+02:00: GET /previous
2023-09-03T20:43:34+02:00: download 'index.json.blob' from previous backup.
2023-09-03T20:43:34+02:00: POST /blob
2023-09-03T20:43:34+02:00: add blob "/mnt/datastore/ProxmoxBackupQNAPDINAX/ct/900/2023-09-03T18:43:31Z/pct.conf.blob" (226 bytes, comp: 226)
2023-09-03T20:43:35+02:00: POST /dynamic_index
2023-09-03T20:43:35+02:00: GET /previous
2023-09-03T20:43:35+02:00: register chunks in 'root.pxar.didx' from previous backup.
2023-09-03T20:43:35+02:00: download 'root.pxar.didx' from previous backup.
2023-09-03T20:43:35+02:00: created new dynamic index 1 ("ct/900/2023-09-03T18:43:31Z/catalog.pcat1.didx")
2023-09-03T20:43:35+02:00: POST /dynamic_index
2023-09-03T20:43:35+02:00: created new dynamic index 2 ("ct/900/2023-09-03T18:43:31Z/root.pxar.didx")
2023-09-03T20:43:35+02:00: POST /dynamic_chunk
2023-09-03T21:01:41+02:00: backup failed: connection error: connection reset
2023-09-03T21:01:41+02:00: removing failed backup
2023-09-03T21:01:41+02:00: TASK ERROR: connection error: connection reset
2023-09-03T21:01:41+02:00: POST /dynamic_chunk: 400 Bad Request: error reading a body from connection: connection reset
==============================

I can ping the PBS, can access the UI, speed to the PBS shows sufficiant speed etc.

I would hope for someone to help me step by step to sort it out. PLEASE NOTE: This is my very first steps with linux etc. In oder to follow your suggestions, PLEASE be so kind and take my hand as a total newbie... step by step... type thism than you see this than make that I know...

Thank you so much
Lem

 

[Chris]

Hi,
according to the logs you showed, the connection to the PBS failed. Please check the systemd journal of both, the Proxmox VE host as well as the Proxmox Backup Server VM for errors around the time of the backup by running journalctl --since <DATETIME> --until <DATETIME> with the appropriate timestamps.

Please further post the PVE version pveversion -v and PBS version proxmox-backup-manager version --verbose.