Hello together,
we've got some issues, when we delete a snapshot or backup from the PVE GUI.
The PVE is backuping to a PBS, when we delete the PVE stops working.
The VMs/Containers don't respond anymore and we can't access them anymore either via noVNC, xterm.js nor SSH.
Please find attached our PVE and PBS versions, as well as the log of the PVE (shortend in thread, fully as attachment)
Thanks for your help and Kind Regards
PBS:
proxmox-backup-server 1.1.13-2 running version: 1.0.8
client version: 1.0.8
we've got some issues, when we delete a snapshot or backup from the PVE GUI.
The PVE is backuping to a PBS, when we delete the PVE stops working.
The VMs/Containers don't respond anymore and we can't access them anymore either via noVNC, xterm.js nor SSH.
Please find attached our PVE and PBS versions, as well as the log of the PVE (shortend in thread, fully as attachment)
Thanks for your help and Kind Regards
17:37:49 pve pvedaemon[25676]: <root@pam> starting task UPID:pve:00006FE2:0BDE909E:612663CD:qmdelsnapshot:105:root@pam:
17:37:49 pve pvedaemon[28642]: <root@pam> delete snapshot VM 105: Before_Moving_Files
17:37:56 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - got timeout
17:38:00 pve systemd[1]: Starting Proxmox VE replication runner...
17:38:01 pve systemd[1]: pvesr.service: Succeeded.
17:38:01 pve systemd[1]: Started Proxmox VE replication runner.
17:38:03 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:03 pve pvestatd[1316]: status update time (6.151 seconds)
17:38:13 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:13 pve pvestatd[1316]: status update time (6.154 seconds)
17:38:15 pve pvedaemon[21135]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:23 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:24 pve pvestatd[1316]: status update time (6.161 seconds)
17:38:33 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:33 pve pvestatd[1316]: status update time (6.160 seconds)
17:38:34 pve pvedaemon[21135]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:43 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:43 pve pvestatd[1316]: status update time (6.148 seconds)
17:38:53 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:38:53 pve pvestatd[1316]: status update time (6.134 seconds)
17:38:54 pve pvedaemon[21135]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:00 pve systemd[1]: Starting Proxmox VE replication runner...
17:39:01 pve systemd[1]: pvesr.service: Succeeded.
17:39:01 pve systemd[1]: Started Proxmox VE replication runner.
17:39:03 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:03 pve pvestatd[1316]: status update time (6.181 seconds)
17:39:13 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:13 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:13 pve pvestatd[1316]: status update time (6.158 seconds)
17:39:23 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:23 pve pvestatd[1316]: status update time (6.164 seconds)
17:39:32 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:34 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:34 pve pvestatd[1316]: status update time (6.145 seconds)
17:39:43 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:43 pve pvestatd[1316]: status update time (6.139 seconds)
17:39:51 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:53 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:39:53 pve pvestatd[1316]: status update time (6.139 seconds)
17:39:59 pve postfix/smtpd[29871]: warning: hostname integer.earacheevince.com does not resolve to address 212.192.246.98
17:39:59 pve postfix/smtpd[29871]: connect from unknown[212.192.246.98]
17:39:59 pve postfix/smtpd[29871]: disconnect from unknown[212.192.246.98] ehlo=1 auth=0/1 rset=1 quit=1 commands=3/4
17:40:00 pve systemd[1]: Starting Proxmox VE replication runner...
17:40:00 pve systemd[1]: pvesr.service: Succeeded.
17:40:00 pve systemd[1]: Started Proxmox VE replication runner.
17:40:03 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:03 pve pvestatd[1316]: status update time (6.144 seconds)
17:40:10 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:13 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:13 pve pvestatd[1316]: status update time (6.146 seconds)
17:40:23 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:23 pve pvestatd[1316]: status update time (6.149 seconds)
17:40:29 pve pvedaemon[21135]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:33 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:33 pve pvestatd[1316]: status update time (6.163 seconds)
17:40:44 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:44 pve pvestatd[1316]: status update time (6.161 seconds)
17:40:49 pve pvedaemon[21135]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:53 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:40:53 pve pvestatd[1316]: status update time (6.153 seconds)
17:41:00 pve systemd[1]: Starting Proxmox VE replication runner...
17:41:01 pve systemd[1]: pvesr.service: Succeeded.
17:41:01 pve systemd[1]: Started Proxmox VE replication runner.
17:41:03 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:03 pve pvestatd[1316]: status update time (6.140 seconds)
17:41:08 pve pvedaemon[25676]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:13 pve pvestatd[1316]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - got timeout
17:41:16 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:16 pve pvestatd[1316]: status update time (9.160 seconds)
17:41:26 pve pvestatd[1316]: VM 100 qmp command failed - VM 100 qmp command 'query-proxmox-support' failed - got timeout
17:41:27 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:29 pve pvestatd[1316]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
17:41:32 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:32 pve pvestatd[1316]: status update time (15.163 seconds)
17:41:44 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:46 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:41:47 pve pvestatd[1316]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
17:41:50 pve pvestatd[1316]: VM 100 qmp command failed - VM 100 qmp command 'query-proxmox-support' failed - unable to connect to VM 100 qmp socket - timeout after 31 retries
17:41:53 pve pvestatd[1316]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - got timeout
17:41:53 pve pvestatd[1316]: status update time (21.167 seconds)
17:42:00 pve systemd[1]: Starting Proxmox VE replication runner...
17:42:01 pve systemd[1]: pvesr.service: Succeeded.
17:42:01 pve systemd[1]: Started Proxmox VE replication runner.
17:42:05 pve pvedaemon[24699]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:42:05 pve pvestatd[1316]: VM 105 qmp command failed - VM 105 qmp command 'query-proxmox-support' failed - unable to connect to VM 105 qmp socket - timeout after 31 retries
17:42:08 pve pvestatd[1316]: VM 113 qmp command failed - VM 113 qmp command 'query-proxmox-support' failed - unable to connect to VM 113 qmp socket - timeout after 31 retries
17:42:11 pve pvestatd[1316]: VM 100 qmp command failed - VM 100 qmp command 'query-proxmox-support' failed - unable to connect to VM 100 qmp socket - timeout after 31 retries
17:42:15 pve pvestatd[1316]: VM 111 qmp command failed - VM 111 qmp command 'query-proxmox-support' failed - unable to connect to VM 111 qmp socket - timeout after 31 retries
17:42:15 pve pvestatd[1316]: status update time (21.178 seconds)
proxmox-ve: 6.3-1 (running kernel: 5.4.103-1-pve)
pve-manager: 6.3-6 (running version: 6.3-6/2184247e)
pve-kernel-5.4: 6.3-7
pve-kernel-helper: 6.3-7
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.4.101-1-pve: 5.4.101-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.7
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-5
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-7
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.10-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-6
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.2-2
pve-qemu-kvm: 5.2.0-3
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-8
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
pve-manager: 6.3-6 (running version: 6.3-6/2184247e)
pve-kernel-5.4: 6.3-7
pve-kernel-helper: 6.3-7
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.4.101-1-pve: 5.4.101-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.7
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-5
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-7
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.10-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-6
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.2-2
pve-qemu-kvm: 5.2.0-3
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-8
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
PBS:
proxmox-backup-server 1.1.13-2 running version: 1.0.8
client version: 1.0.8