problem in LVM disk creation when instantiating VM

[proxman]

Hi,

When i try to create a new VM on proxmox 2.3-13, i get this error

trying to aquire cfs lock 'storage-pve_lvm' ...TASK ERROR: create failed - got lock request timeout

Syslog shows about every 10 seconds this messages:

Apr 9 13:44:46 pve01 pmxcfs[876766]: [dcdb] notice: start cluster connection
Apr 9 13:44:46 pve01 pmxcfs[876766]: [dcdb] crit: internal error - unknown mode 0
Apr 9 13:44:46 pve01 pmxcfs[876766]: [dcdb] crit: leaving CPG group

More-or-less randomly restarting services on the problematic node fixed this, but i would like to know what this might have caused.
Hint: I tried a VM backup some days before which stalled and i just forgot about. Might be the cause, please comment.

What is the correct way to fix such issue in the future?

Regards,
Proxman

 

[tom]

you run a cluster? seems you have cluster communication issue, check your cluster config, syslogs and cluster status.

and post your 'pveversion -v' and 'cat /etc/pve/cluster.conf' and your 'cat /etc/pve/storage.cfg'

and tell more about "storage-pve_lvm"

 

[proxman]

Yes a 5 node cluster.
pveversion -v

pve-manager: 2.3-13 (pve-manager/2.3/7946f1f1)
running kernel: 2.6.32-18-pve
proxmox-ve-2.6.32: 2.3-88
pve-kernel-2.6.32-11-pve: 2.6.32-66
pve-kernel-2.6.32-18-pve: 2.6.32-88
lvm2: 2.02.95-1pve2
clvm: 2.02.95-1pve2
corosync-pve: 1.4.4-4
openais-pve: 1.1.4-2
libqb: 0.10.1-2
redhat-cluster-pve: 3.1.93-2
resource-agents-pve: 3.9.2-3
fence-agents-pve: 3.1.9-1
pve-cluster: 1.0-36
qemu-server: 2.3-18
pve-firmware: 1.0-21
libpve-common-perl: 1.0-48
libpve-access-control: 1.0-26
libpve-storage-perl: 2.3-6
vncterm: 1.0-3
vzctl: 4.0-1pve2
vzprocps: 2.0.11-2
vzquota: 3.1-1
pve-qemu-kvm: 1.4-8
ksm-control-daemon: 1.1-1

cat /etc/pve/cluster.conf

<?xml version="1.0"?>
<cluster name="pve" config_version="5">


  <cman keyfile="/var/lib/pve-cluster/corosync.authkey">
  </cman>


  <clusternodes>
  <clusternode name="pve01" votes="1" nodeid="1"/>
  <clusternode name="pve02" votes="1" nodeid="2"/>
  <clusternode name="pve03" votes="1" nodeid="3"/>
  <clusternode name="pve04" votes="1" nodeid="4"/>
  <clusternode name="pve05" votes="1" nodeid="5"/>
  </clusternodes>



</cluster>

cat /etc/pve/storage.cfg

dir: local
        path /var/lib/vz
        content images,iso,vztmpl,backup,rootdir
        maxfiles 0


iscsi: pve_iscsi
        target iqn.1992-08.com.netapp:sn.xxxxxx171
        portal 10.96.28.100
        content none


lvm: pve_lvm
        vgname pve_lvm
        shared
        content images