Recently I had a power failure in the server room, after that all the servers started successfully and worked for two days without errors. But a day ago all the nodes in my cluster became red.
I used my old simple script to restart all the needed services like this:
Earlier this simple script did all the job if the cluster sometimes begun to behave incorrectly.
But now the cman service cannot stop, it hangs with the message:
I need to press Ctrl+C to abort the process. After that cman starts without errors
Is there anything I can do with that?
Here is the cluster config:
I used my old simple script to restart all the needed services like this:
Code:
#!/bin/bash
service pvestatd stop
service pvedaemon stop
service cman stop
service pve-cluster stop
sleep 2
service pve-cluster start
service cman start
service pvestatd start
service pvedaemon start
Earlier this simple script did all the job if the cluster sometimes begun to behave incorrectly.
But now the cman service cannot stop, it hangs with the message:
Code:
root@srv-bld-a07:~# service cman stop
Stopping cluster:
Stopping dlm_controld... [ OK ]
Stopping fenced... [ OK ]
Stopping cman... [ OK ]
Waiting for corosync to shutdown:[ OK ]
Unloading kernel modules... [ OK ]
Unmounting configfs...
I need to press Ctrl+C to abort the process. After that cman starts without errors
Is there anything I can do with that?
Here is the cluster config:
Code:
root@srv-bld-a07:~# pveversion -v
pve-manager: 3.0-23 (pve-manager/3.0/957f0862)
running kernel: 2.6.32-20-pve
proxmox-ve-2.6.32: 3.0-100
pve-kernel-2.6.32-11-pve: 2.6.32-66
pve-kernel-2.6.32-20-pve: 2.6.32-100
pve-kernel-2.6.32-16-pve: 2.6.32-82
pve-kernel-2.6.32-12-pve: 2.6.32-68
pve-kernel-2.6.32-19-pve: 2.6.32-95
pve-kernel-2.6.32-18-pve: 2.6.32-88
pve-kernel-2.6.32-17-pve: 2.6.32-83
lvm2: 2.02.95-pve3
clvm: 2.02.95-pve3
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.0-1
pve-cluster: 3.0-4
qemu-server: 3.0-20
pve-firmware: 1.0-22
libpve-common-perl: 3.0-4
libpve-access-control: 3.0-4
libpve-storage-perl: 3.0-8
vncterm: 1.1-4
vzctl: 4.0-1pve3
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.4-13
ksm-control-daemon: 1.1-1
Code:
root@srv-bld-a07:~# pvecm status
Version: 6.2.0
Config Version: 11
Cluster Name: AVTOZAVOD
Cluster Id: 38082
Cluster Member: Yes
Cluster Generation: 4740
Membership state: Cluster-Member
Nodes: 5
Expected votes: 5
Total votes: 5
Node votes: 1
Quorum: 3
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: srv-bld-a07
Node ID: 3
Multicast addresses: 239.192.148.87
Node addresses: 172.16.10.237
Code:
root@srv-bld-a07:~# pvecm nodes
Node Sts Inc Joined Name
1 M 4740 2013-10-31 13:44:39 srv-bld-a04
2 M 4740 2013-10-31 13:44:39 srv-bld-a05
3 M 4736 2013-10-31 13:44:39 srv-bld-a07
4 M 4740 2013-10-31 13:44:39 srv-bld-a03
5 M 4740 2013-10-31 13:44:39 srv-bld-a06
Last edited: