clean up after backup crash

E

ELS_sean

Member
Jan 12, 2012
19
1
23
Mesa, Arizona
Hi All,

I am trying to find out what I need to do after a backup crash to make it work again. I am getting the fault:
INFO: starting new backup job: vzdump 100 --remove 0 --mode snapshot --compress lzo --storage fourTB_Backup --node proxmox
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: VM is locked (backup)
ERROR: Backup of VM 100 failed - command 'qm set 100 --lock backup' failed: exit code 25
INFO: Backup job finished with errors
TASK ERROR: job errors

The issue was the backup volume was not mounted. I have since mounted it.
I am running the latest Proxmox VE

Thanks,
Sean


 
ELS_sean said:
Hmmm, that didnt work:
root@proxmox:~# qm unlock 100
unable to open file '/etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.382977' - Input/output error

AM I missing something?

Sean
Click to expand...
Hi,
can you post the output of following commands?
Code: 
ls -l /etc/pve/nodes/proxmox/qemu-server/
cat /etc/pve/nodes/proxmox/qemu-server/100.conf
ps aux | grep 100
uptime
Udo
 
Sure:

root@proxmox:~# ls -l /etc/pve/nodes/proxmox/qemu-server/
total 6
-rw-r----- 1 root www-data 220 Mar 16 08:40 100.conf
-rw-r----- 1 root www-data 0 Mar 16 09:17 100.conf.tmp.367376
-rw-r----- 1 root www-data 220 Sep 4 2014 101.conf
-rw-r----- 1 root www-data 194 Dec 2 10:48 102.conf
-rw-r----- 1 root www-data 175 Sep 4 2014 103.conf
-rw-r----- 1 root www-data 228 Sep 4 2014 104.conf
-rw-r----- 1 root www-data 254 Feb 2 2014 105.conf
-rw-r----- 1 root www-data 252 Sep 3 2014 106.conf
-rw-r----- 1 root www-data 277 Jan 13 07:10 107.conf
-rw-r----- 1 root www-data 276 Jan 13 07:21 108.conf
-rw-r----- 1 root www-data 277 Feb 17 14:38 109.conf
-rw-r----- 1 root www-data 283 Mar 6 10:51 110.conf
root@proxmox:~#

root@proxmox:~# cat /etc/pve/nodes/proxmox/qemu-server/100.conf
bootdisk: ide0
cores: 1
ide0: local:100/vm-100-disk-1.raw,format=raw,size=500G
ide2: cdrom,media=cdrom
lock: backup
memory: 2048
name: Mustang2
net0: e1000=FE:0C:02:7C:E9:39,bridge=vmbr0
onboot: 1
ostype: l26
sockets: 1

root@proxmox:~# ps aux | grep 100
root 2937 8.7 6.0 2479440 1981448 ? Sl Mar04 1486:34 /usr/bin/kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -vnc unix:/var/run/qemu-server/100.vnc,x509,password -pidfile /var/run/qemu-server/100.pid -daemonize -name Mustang2 -smp 1,sockets=1,cores=1,maxcpus=1 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000 -vga cirrus -cpu kvm64,+lahf_lm,+x2apic,+sep -m 2048 -k en-us -cpuunits 1000 -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=tablet,bus=uhci.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:b7c7bfc87d2b -drive file=/dev/cdrom,if=none,id=drive-ide2,media=cdrom,aio=native -device ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200 -drive file=/var/lib/vz/images/100/vm-100-disk-1.raw,if=none,id=drive-ide0,format=raw,aio=native,cache=none,detect-zeroes=on -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100 -netdev type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=FE:0C:02:7C:E9:39,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
root 2962 6.2 2.1 2487468 718280 ? Sl Mar04 1066:54 /usr/bin/kvm -id 102 -chardev socket,id=qmp,path=/var/run/qemu-server/102.qmp,server,nowait -mon chardev=qmp,mode=control -vnc unix:/var/run/qemu-server/102.vnc,x509,password -pidfile /var/run/qemu-server/102.pid -daemonize -name MariaDB -smp 2,sockets=2,cores=1,maxcpus=2 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000 -vga cirrus -cpu kvm64,+lahf_lm,+x2apic,+sep -m 2048 -k en-us -cpuunits 1000 -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=tablet,bus=uhci.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:b7c7bfc87d2b -drive file=/var/lib/vz/images/102/vm-102-disk-1.qcow2,if=none,id=drive-ide0,format=qcow2,aio=native,cache=none,detect-zeroes=on -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100 -netdev type=tap,id=net0,ifname=tap102i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=6E:A8:34:03:C1:F1,netdev=net0,bus=pci.0,addr=0x12,id=net0
root 3000 6.1 3.2 1508212 1067216 ? Sl Mar04 1045:08 /usr/bin/kvm -id 105 -chardev socket,id=qmp,path=/var/run/qemu-server/105.qmp,server,nowait -mon chardev=qmp,mode=control -vnc unix:/var/run/qemu-server/105.vnc,x509,password -pidfile /var/run/qemu-server/105.pid -daemonize -name centos6 -smp 1,sockets=1,cores=1,maxcpus=1 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000 -vga cirrus -cpu kvm64,+lahf_lm,+x2apic,+sep -m 1024 -k en-us -cpuunits 1000 -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=tablet,bus=uhci.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:b7c7bfc87d2b -drive file=/var/lib/vz/template/iso/CentOS-6.5-i386-netinstall.iso,if=none,id=drive-ide2,media=cdrom,aio=native -device ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200 -drive file=/var/lib/vz/images/105/vm-105-disk-1.qcow2,if=none,id=drive-ide0,format=qcow2,aio=native,cache=none,detect-zeroes=on -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100 -netdev type=tap,id=net0,ifname=tap105i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=2E:07:0F:94:36:E5,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
root 3025 0.2 0.8 1371284 274728 ? Sl Mar04 35:01 /usr/bin/kvm -id 106 -chardev socket,id=qmp,path=/var/run/qemu-server/106.qmp,server,nowait -mon chardev=qmp,mode=control -vnc unix:/var/run/qemu-server/106.vnc,x509,password -pidfile /var/run/qemu-server/106.pid -daemonize -name Centos7 -smp 1,sockets=1,cores=1,maxcpus=1 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000 -vga cirrus -cpu kvm64,+lahf_lm,+x2apic,+sep -m 1024 -k en-us -cpuunits 1000 -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=tablet,bus=uhci.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:b7c7bfc87d2b -drive file=/var/lib/vz/template/iso/CentOS-7.0-1406-x86_64-NetInstall.iso,if=none,id=drive-ide2,media=cdrom,aio=native -device ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200 -drive file=/var/lib/vz/images/106/vm-106-disk-1.qcow2,if=none,id=drive-ide0,format=qcow2,aio=native,cache=none,detect-zeroes=on -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100 -netdev type=tap,id=net0,ifname=tap106i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=7A:AB:A9:A6:16:22,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
root 208268 6.2 3.2 1441696 1067984 ? Sl Mar06 912:05 /usr/bin/kvm -id 110 -chardev socket,id=qmp,path=/var/run/qemu-server/110.qmp,server,nowait -mon chardev=qmp,mode=control -vnc unix:/var/run/qemu-server/110.vnc,x509,password -pidfile /var/run/qemu-server/110.pid -daemonize -smbios type=1,uuid=81087498-fab9-4ead-9f36-561cbc4687f7 -name OwnCloud -smp 1,sockets=1,cores=1,maxcpus=1 -nodefaults -boot menu=on,strict=on,reboot-timeout=1000 -vga cirrus -cpu kvm64,+lahf_lm,+x2apic,+sep -m 1024 -k en-us -cpuunits 1000 -device piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=tablet,bus=uhci.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3 -iscsi initiator-name=iqn.1993-08.org.debian:01:b7c7bfc87d2b -drive file=/var/lib/vz/template/iso/CentOS-6.6-x86_64-netinstall.iso,if=none,id=drive-ide2,media=cdrom,aio=native -device ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200 -drive file=/var/lib/vz/images/110/vm-110-disk-1.qcow2,if=none,id=drive-ide0,format=qcow2,aio=native,cache=none,detect-zeroes=on -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100 -netdev type=tap,id=net0,ifname=tap110i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown -device e1000,mac=76:12:48:13:AD:BE,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
root 383923 0.0 0.0 7792 928 pts/0 S+ 12:25 0:00 grep 100
root@proxmox:~#


root@proxmox:~# uptime
12:26:39 up 11 days, 18:52, 1 user, load average: 0.12, 0.07, 0.04
root@proxmox:~#
 
udo said:
Hi,
do you see any running backup-job:
Code: 
ps aux | grep vzdump
If not, remove the tmp-file (rm /etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.367376 ) and try unlock again

Udo
Click to expand...

I cant seem to kill that file:

root@proxmox:~# ps aux | grep vzdump
root 385865 0.0 0.0 7788 924 pts/0 S+ 12:48 0:00 grep vzdump
root@proxmox:~# rm /etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.367376
rm: cannot remove `/etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.367376': Input/output error
root@proxmox:~# ls -la /etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.367376
-rw-r----- 1 root www-data 0 Mar 16 09:17 /etc/pve/nodes/proxmox/qemu-server/100.conf.tmp.367376

Sean
 
udo said:
Hi,
is the node part of an cluster?
Do you have quorum (without quorum /etc/pve is write protected).

Code: 
clustat
pvecm nodes
pvecm status
Udo
Click to expand...


Hi Udo,

Thanks for all your help BTW, it is a single machine with not in a cluster; here is the output:

root@proxmox:~# clustat
Could not connect to CMAN: No such file or directory
root@proxmox:~# pvecm nodes
cman_tool: Cannot open connection to cman, is it running ?
root@proxmox:~# pvecm status
cman_tool: Cannot open connection to cman, is it running ?
 
ELS_sean said:
Hi Udo,

Thanks for all your help BTW, it is a single machine with not in a cluster; here is the output:

root@proxmox:~# clustat
Could not connect to CMAN: No such file or directory
root@proxmox:~# pvecm nodes
cman_tool: Cannot open connection to cman, is it running ?
root@proxmox:~# pvecm status
cman_tool: Cannot open connection to cman, is it running ?
Click to expand...

Hi,
does an
Code: 
service pve-cluster restart
help?

Udo
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back