Backup failed

Globul · Feb 25, 2021

Hi,

Since the last update of Proxmox, I have a lot of problems with backups.
Some of my backups are as before, but others are not.

VMID	NAME	STATUS	TIME	SIZE	FILENAME
100	OMV	OK	00:02:22	7.25GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-100-2021_02_24-03_30_02.vma
101	PIHOLE	FAILED	00:10:36	unable to connect to VM 101 qmp socket - timeout after 299 retries
102	ZONEMINDER	FAILED	00:10:36	unable to connect to VM 102 qmp socket - timeout after 300 retries
104	JEEDOM	FAILED	00:10:37	unable to connect to VM 104 qmp socket - timeout after 301 retries
106	JDOWNLOADER	OK	00:04:03	13.87GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-106-2021_02_24-04_04_13.vma
108	WINSERV	OK	00:10:18	34.77GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-108-2021_02_24-04_08_16.vma
112	MAILGATEWAY	FAILED	00:10:37	unable to connect to VM 112 qmp socket - timeout after 301 retries
114	MINESERVDOR	FAILED	00:10:36	unable to connect to VM 114 qmp socket - timeout after 301 retries
TOTAL	01:09:45	55.88GB

VMID	NAME	STATUS	TIME	SIZE	FILENAME
100	OMV	OK	00:02:17	7.42GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-100-2021_02_25-03_30_03.vma
103	FILEMAKER	OK	00:07:10	24.14GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-103-2021_02_25-03_32_20.vma
105	NEXTCLOUD	FAILED	00:10:37	unable to connect to VM 105 qmp socket - timeout after 299 retries
109	PLEX	OK	00:14:36	48.91GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-109-2021_02_25-03_50_07.vma
110	OPENVPN	FAILED	00:10:36	unable to connect to VM 110 qmp socket - timeout after 300 retries
111	VEEAM	FAILED	00:10:37	unable to connect to VM 111 qmp socket - timeout after 301 retries
113	MINESERV	OK	00:03:27	10.72GB	/mnt/pve/Backupproxmox/dump/vzdump-qemu-113-2021_02_25-04_25_56.vma
TOTAL	00:59:20	91.19GB

I have this error message :

Code:

110: 2021-02-25 04:04:43 INFO: Starting Backup of VM 110 (qemu)
110: 2021-02-25 04:04:43 INFO: status = running
110: 2021-02-25 04:04:43 INFO: VM Name: OPENVPN
110: 2021-02-25 04:04:46 INFO: include disk 'scsi0' 'local-lvm:vm-110-disk-0' 32G
110: 2021-02-25 04:04:46 INFO: backup mode: snapshot
110: 2021-02-25 04:04:46 INFO: ionice priority: 7
110: 2021-02-25 04:04:46 INFO: creating vzdump archive '/mnt/pve/Backupproxmox/dump/vzdump-qemu-110-2021_02_25-04_04_43.vma'
110: 2021-02-25 04:04:49 INFO: skipping guest-agent 'fs-freeze', agent configured but not running?
110: 2021-02-25 04:05:19 ERROR: unable to connect to VM 110 qmp socket - timeout after 300 retries
110: 2021-02-25 04:05:19 INFO: aborting backup job
110: 2021-02-25 04:15:19 ERROR: VM 110 qmp command 'backup-cancel' failed - unable to connect to VM 110 qmp socket - timeout after 5977 retries
110: 2021-02-25 04:15:19 ERROR: Backup of VM 110 failed - unable to connect to VM 110 qmp socket - timeout after 300 retries

When the problem occurs, I can't connect to my VM (either Windows or linux). I can't restart or stop it ...

Code:

trying to acquire lock...
TASK ERROR: can't lock file '/var/lock/qemu-server/lock-108.conf' - got timeout

I tried to remove lock-www.conf file, but it didn't solve the problem

Code:

rm /run/lock/qemu-server/lock-110.conf

Code:

rm /var/lock/qemu-server/lock-110.conf

Each time ive to reboot Proxmox to solve the problem.

After reboot, the guest-agent works fine.
I never had this probleme since the last year with the same backup configuration.

Proxmox version :

Code:

proxmox-ve: 6.3-1 (running kernel: 5.4.98-1-pve)
pve-manager: 6.3-4 (running version: 6.3-4/0a38c56f)
pve-kernel-5.4: 6.3-5
pve-kernel-helper: 6.3-5
pve-kernel-5.4.98-1-pve: 5.4.98-1
pve-kernel-5.4.78-2-pve: 5.4.78-2
pve-kernel-5.4.65-1-pve: 5.4.65-1
pve-kernel-5.4.55-1-pve: 5.4.55-1
pve-kernel-5.4.44-2-pve: 5.4.44-2
pve-kernel-5.4.34-1-pve: 5.4.34-2

Moayad · Feb 26, 2021

have you checked Syslog for any hint?

could you please post the full output of pveversion -v

what about containers is the problem occurs them?

Globul · Feb 26, 2021

Moayad said:
have you checked Syslog for any hint?

could you please post the full output of pveversion -v

what about containers is the problem occurs them?

Thanks for your answer.

I have nothing in the syslog before my last reboot of proxmox and i don't have any container.

I have suspend all my backup job and i didn't have any problem since. I don't try to launch a manual backup yet.

Here is the output of pveversion -v

Code:

proxmox-ve: 6.3-1 (running kernel: 5.4.98-1-pve)
pve-manager: 6.3-4 (running version: 6.3-4/0a38c56f)
pve-kernel-5.4: 6.3-5
pve-kernel-helper: 6.3-5
pve-kernel-5.4.98-1-pve: 5.4.98-1
pve-kernel-5.4.78-2-pve: 5.4.78-2
pve-kernel-5.4.65-1-pve: 5.4.65-1
pve-kernel-5.4.55-1-pve: 5.4.55-1
pve-kernel-5.4.44-2-pve: 5.4.44-2
pve-kernel-5.4.34-1-pve: 5.4.34-2
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.7
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-4
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-7
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.8-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-5
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.2-2
pve-qemu-kvm: 5.2.0-1
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-5
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.3-pve1

Globul · Mar 3, 2021

Hello,

I tried to launch manual backup and i have the same problem. After having launch a backup (of one VM) some of qmagent stop their communication (not the backup VM). I have to stop the VM and relaunch it ...

Code:

Mar 03 08:13:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:14:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:14:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:14:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:15:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:15:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:15:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:15:29 pve pvedaemon[35388]: <root@pam> successful auth for user 'root@pam'
Mar 03 08:15:46 pve pvedaemon[35388]: <root@pam> starting task UPID:pve:0000B2D0:0310EB4E:603F37A2:imgdel:109@Backupproxmox:root@pam:
Mar 03 08:15:48 pve pvedaemon[35388]: <root@pam> end task UPID:pve:0000B2D0:0310EB4E:603F37A2:imgdel:109@Backupproxmox:root@pam: OK
Mar 03 08:15:56 pve pvedaemon[1743]: <root@pam> starting task UPID:pve:0000B2F5:0310EF1B:603F37AC:vzdump:109:root@pam:
Mar 03 08:15:56 pve pvedaemon[45813]: INFO: starting new backup job: vzdump 109 --node pve --remove 0 --mode snapshot --storage Backupproxmox --compress 0
Mar 03 08:15:57 pve pvedaemon[45813]: INFO: Starting Backup of VM 109 (qemu)
Mar 03 08:16:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:16:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:16:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:16:01 pve pvedaemon[35489]: worker exit
Mar 03 08:16:27 pve pvedaemon[1743]: worker exit
Mar 03 08:16:39 pve pvedaemon[1513]: worker 1743 finished
Mar 03 08:16:39 pve pvedaemon[1513]: worker 35489 finished
Mar 03 08:16:39 pve pvedaemon[1513]: starting 2 worker(s)
Mar 03 08:16:39 pve pvedaemon[1513]: worker 45966 started
Mar 03 08:16:39 pve pvedaemon[1513]: worker 45967 started
Mar 03 08:17:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:17:01 pve CRON[46032]: pam_unix(cron:session): session opened for user root by (uid=0)
Mar 03 08:17:01 pve CRON[46033]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Mar 03 08:17:01 pve CRON[46032]: pam_unix(cron:session): session closed for user root
Mar 03 08:17:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:17:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:17:32 pve pvedaemon[35388]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:17:39 pve pvestatd[1486]: status update time (5.367 seconds)
Mar 03 08:17:58 pve pvedaemon[35388]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:18:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:18:00 pve pvestatd[1486]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:18:01 pve pvestatd[1486]: status update time (6.639 seconds)
Mar 03 08:18:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:18:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:18:07 pve pvedaemon[35388]: worker exit
Mar 03 08:18:08 pve pvedaemon[1513]: worker 35388 finished
Mar 03 08:18:08 pve pvedaemon[1513]: starting 1 worker(s)
Mar 03 08:18:08 pve pvedaemon[1513]: worker 46266 started
Mar 03 08:18:25 pve pvedaemon[45966]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:19:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:19:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:19:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:19:46 pve pvedaemon[46266]: <root@pam> successful auth for user 'root@pam'
Mar 03 08:20:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:20:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:20:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:20:24 pve pvedaemon[45966]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:20:30 pve pvestatd[1486]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:20:33 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 08:20:34 pve pvestatd[1486]: status update time (9.807 seconds)
Mar 03 08:20:40 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:20:40 pve pvestatd[1486]: status update time (6.675 seconds)
Mar 03 08:20:49 pve pvedaemon[45966]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:20:53 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 08:20:56 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:20:57 pve pvestatd[1486]: status update time (12.782 seconds)
Mar 03 08:21:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:21:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:21:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:21:06 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:21:09 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 08:21:12 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:21:13 pve pvestatd[1486]: status update time (15.751 seconds)
Mar 03 08:21:25 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 08:21:28 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:21:31 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:21:32 pve pvestatd[1486]: status update time (18.789 seconds)
Mar 03 08:21:38 pve pvedaemon[45967]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:21:44 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:21:47 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:21:50 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 08:21:53 pve pvestatd[1486]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 08:21:53 pve pvestatd[1486]: status update time (21.825 seconds)
Mar 03 08:21:57 pve pvedaemon[46266]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:22:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 08:22:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 08:22:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 08:22:09 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 08:22:12 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:22:15 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:22:16 pve pvestatd[1486]: status update time (22.426 seconds)
Mar 03 08:22:23 pve pvedaemon[45966]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Mar 03 08:22:28 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 08:22:31 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:22:34 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:22:35 pve pvestatd[1486]: status update time (18.872 seconds)
Mar 03 08:22:47 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 08:22:50 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 08:22:53 pve pvestatd[1486]: VM 102 qmp command failed - VM 102 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 08:22:56 pve pvestatd[1486]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
Mar 03 08:22:56 pve pvestatd[1486]: status update time (21.796 seconds)
Mar 03 08:23:00 pve systemd[1]: Starting Proxmox VE replication runner...

Globul · Mar 3, 2021

And this one :

Code:

Mar 03 14:00:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:00:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:01:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:01:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:01:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:02:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:02:01 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:02:01 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:02:10 pve pvedaemon[2639]: <root@pam> starting task UPID:pve:00009EB1:0330A22C:603F88D2:imgdel:108@Backupproxmox:root@pam:
Mar 03 14:02:10 pve pvedaemon[2639]: <root@pam> end task UPID:pve:00009EB1:0330A22C:603F88D2:imgdel:108@Backupproxmox:root@pam: OK
Mar 03 14:02:17 pve pvedaemon[38594]: <root@pam> starting task UPID:pve:00009ED9:0330A4B9:603F88D9:vzdump:108:root@pam:
Mar 03 14:02:17 pve pvedaemon[40665]: INFO: starting new backup job: vzdump 108 --storage Backupproxmox --compress 0 --node pve --remove 0 --mode snapshot
Mar 03 14:02:17 pve pvedaemon[40665]: INFO: Starting Backup of VM 108 (qemu)
Mar 03 14:03:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:03:01 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:03:02 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:03:02 pve pvestatd[1486]: status update time (6.683 seconds)
Mar 03 14:03:03 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:03:03 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:03:12 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:03:13 pve pvestatd[1486]: status update time (6.736 seconds)
Mar 03 14:03:20 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:03:22 pve pvestatd[1486]: status update time (5.783 seconds)
Mar 03 14:04:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:04:03 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:04:03 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:04:49 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:05:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:05:02 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:05:02 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:05:44 pve pvedaemon[6805]: <root@pam> successful auth for user 'root@pam'
Mar 03 14:05:52 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:05:53 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:05:53 pve pvestatd[1486]: status update time (6.818 seconds)
Mar 03 14:06:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:06:02 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:06:03 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:06:03 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:06:03 pve pvestatd[1486]: status update time (6.835 seconds)
Mar 03 14:06:22 pve pveproxy[1523]: worker 28007 finished
Mar 03 14:06:22 pve pveproxy[1523]: starting 1 worker(s)
Mar 03 14:06:22 pve pveproxy[1523]: worker 41430 started
Mar 03 14:06:24 pve pveproxy[41429]: got inotify poll request in wrong process - disabling inotify
Mar 03 14:06:26 pve pveproxy[41429]: worker exit
Mar 03 14:06:55 pve pvedaemon[6805]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:07:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:07:02 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:07:02 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:07:02 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:07:02 pve pvestatd[1486]: status update time (6.631 seconds)
Mar 03 14:07:12 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:07:14 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:07:15 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:07:16 pve pvestatd[1486]: status update time (9.645 seconds)
Mar 03 14:07:22 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:07:23 pve pvestatd[1486]: status update time (6.689 seconds)
Mar 03 14:07:32 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:07:32 pve pvestatd[1486]: status update time (6.742 seconds)
Mar 03 14:07:43 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:07:44 pve pvestatd[1486]: status update time (7.183 seconds)
Mar 03 14:07:52 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:07:53 pve pvestatd[1486]: status update time (6.887 seconds)
Mar 03 14:08:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:08:02 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:08:03 pve pvestatd[1486]: status update time (7.310 seconds)
Mar 03 14:08:04 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:08:04 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:08:13 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:08:13 pve pvestatd[1486]: status update time (7.416 seconds)
Mar 03 14:08:23 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:08:24 pve pvestatd[1486]: status update time (7.424 seconds)
Mar 03 14:08:32 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:08:35 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:08:37 pve pvestatd[1486]: status update time (10.938 seconds)
Mar 03 14:08:46 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:08:49 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:08:49 pve pvestatd[1486]: status update time (12.690 seconds)
Mar 03 14:08:54 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:08:59 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:09:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:09:02 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:09:02 pve pvestatd[1486]: status update time (12.838 seconds)
Mar 03 14:09:05 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:09:05 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:09:14 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:09:17 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:09:18 pve pvestatd[1486]: status update time (15.752 seconds)
Mar 03 14:09:27 pve pvestatd[1486]: VM 116 qmp command failed - VM 116 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:09:30 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:09:33 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:09:37 pve pvestatd[1486]: status update time (18.836 seconds)
Mar 03 14:09:49 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:09:52 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:09:55 pve pvestatd[1486]: VM 116 qmp command failed - VM 116 qmp command 'query-proxmox-support' failed - unable to connect to VM 116 qmp socket - timeout after 31 retries
Mar 03 14:09:56 pve pvestatd[1486]: status update time (18.869 seconds)
Mar 03 14:10:00 pve systemd[1]: Starting Proxmox VE replication runner...
Mar 03 14:10:04 pve systemd[1]: pvesr.service: Succeeded.
Mar 03 14:10:04 pve systemd[1]: Started Proxmox VE replication runner.
Mar 03 14:10:05 pve pvedaemon[38594]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:10:08 pve pvestatd[1486]: VM 116 qmp command failed - VM 116 qmp command 'query-proxmox-support' failed - unable to connect to VM 116 qmp socket - timeout after 31 retries
Mar 03 14:10:11 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:10:14 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:10:17 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:10:18 pve pvestatd[1486]: status update time (21.984 seconds)
Mar 03 14:10:30 pve pvestatd[1486]: VM 114 qmp command failed - VM 114 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:10:31 pve pvedaemon[2639]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:10:33 pve pvestatd[1486]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - unable to connect to VM 108 qmp socket - timeout after 31 retries
Mar 03 14:10:36 pve pvestatd[1486]: VM 110 qmp command failed - VM 110 qmp command 'query-proxmox-support' failed - unable to connect to VM 110 qmp socket - timeout after 31 retries
Mar 03 14:10:39 pve pvestatd[1486]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
Mar 03 14:10:42 pve pvestatd[1486]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:10:45 pve pvestatd[1486]: VM 116 qmp command failed - VM 116 qmp command 'query-proxmox-support' failed - unable to connect to VM 116 qmp socket - timeout after 31 retries
Mar 03 14:10:46 pve pvestatd[1486]: status update time (27.924 seconds)
Mar 03 14:10:52 pve pvedaemon[2639]: VM 108 qmp command failed - VM 108 qmp command 'query-proxmox-support' failed - got timeout
Mar 03 14:10:58 pve pvestatd[1486]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
Mar 03 14:10:58 pve pveproxy[37635]: worker exit
Mar 03 14:10:58 pve pveproxy[1523]: worker 37635 finished
Mar 03 14:10:58 pve pveproxy[1523]: starting 1 worker(s)
Mar 03 14:10:58 pve pveproxy[1523]: worker 42221 started
Mar 03 14:11:00 pve systemd[1]: Starting Proxmox VE replication runner...

Search

Search

Backup failed

Globul

Member

Moayad

Proxmox Staff Member

Globul

Member

Globul

Member

Globul

Member