Hi all,
Yesterday was update day : 5 nodes cluster, pve v2.1.
apt-get update
apt-get -y upgrade gives on each of the faive nodes :
Reading package lists...
Building dependency tree...
Reading state information...
The following packages have been kept back:
proxmox-ve-2.6.32 pve-qemu-kvm qemu-server
The following packages will be upgraded:
bind9-host dnsutils fence-agents-pve isc-dhcp-client isc-dhcp-common
libbind9-60 libdns69 libexpat1 libgssapi-krb5-2 libgssrpc4 libisc62
libisccc60 libisccfg62 libk5crypto3 libkadm5clnt-mit7 libkadm5srv-mit7
libkdb5-4 libkrb5-3 libkrb5support0 liblwres60 libpq5 libpve-access-control
libpve-common-perl libpve-storage-perl libxml2 libxml2-utils pve-cluster
pve-firmware pve-manager redhat-cluster-pve vncterm
31 upgraded, 0 newly installed, 0 to remove and 3 not upgraded.
Need to get 23.6 MB of archives.
After this operation, 659 kB of additional disk space will be used.
[...]Series of Get:
Reading changelogs...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 23.6 MB in 19s (1,236 kB/s)
(Reading database ... 40669 files and directories currently installed.)
Preparing to replace isc-dhcp-client 4.1.1-P1-15+squeeze3 (using .../isc-dhcp-client_4.1.1-P1-15+squeeze6_amd64.deb) ...
Unpacking replacement isc-dhcp-client ...
Preparing to replace isc-dhcp-common 4.1.1-P1-15+squeeze3 (using .../isc-dhcp-common_4.1.1-P1-15+squeeze6_amd64.deb) ...
Unpacking replacement isc-dhcp-common ...
Preparing to replace libk5crypto3 1.8.3+dfsg-4squeeze5 (using .../libk5crypto3_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libk5crypto3 ...
Preparing to replace libgssapi-krb5-2 1.8.3+dfsg-4squeeze5 (using .../libgssapi-krb5-2_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libgssapi-krb5-2 ...
Preparing to replace libkrb5-3 1.8.3+dfsg-4squeeze5 (using .../libkrb5-3_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkrb5-3 ...
Preparing to replace libkrb5support0 1.8.3+dfsg-4squeeze5 (using .../libkrb5support0_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkrb5support0 ...
Preparing to replace libxml2 2.7.8.dfsg-2+squeeze4 (using .../libxml2_2.7.8.dfsg-2+squeeze5_amd64.deb) ...
Unpacking replacement libxml2 ...
Preparing to replace bind9-host 1:9.7.3.dfsg-1~squeeze5 (using .../bind9-host_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement bind9-host ...
Preparing to replace dnsutils 1:9.7.3.dfsg-1~squeeze5 (using .../dnsutils_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement dnsutils ...
Preparing to replace libisc62 1:9.7.3.dfsg-1~squeeze5 (using .../libisc62_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisc62 ...
Preparing to replace libdns69 1:9.7.3.dfsg-1~squeeze5 (using .../libdns69_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libdns69 ...
Preparing to replace libisccc60 1:9.7.3.dfsg-1~squeeze5 (using .../libisccc60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisccc60 ...
Preparing to replace libisccfg62 1:9.7.3.dfsg-1~squeeze5 (using .../libisccfg62_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisccfg62 ...
Preparing to replace liblwres60 1:9.7.3.dfsg-1~squeeze5 (using .../liblwres60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement liblwres60 ...
Preparing to replace libbind9-60 1:9.7.3.dfsg-1~squeeze5 (using .../libbind9-60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libbind9-60 ...
Preparing to replace libgssrpc4 1.8.3+dfsg-4squeeze5 (using .../libgssrpc4_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libgssrpc4 ...
Preparing to replace libkadm5clnt-mit7 1.8.3+dfsg-4squeeze5 (using .../libkadm5clnt-mit7_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkadm5clnt-mit7 ...
Preparing to replace libkdb5-4 1.8.3+dfsg-4squeeze5 (using .../libkdb5-4_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkdb5-4 ...
Preparing to replace libkadm5srv-mit7 1.8.3+dfsg-4squeeze5 (using .../libkadm5srv-mit7_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkadm5srv-mit7 ...
Preparing to replace libpve-common-perl 1.0-27 (using .../libpve-common-perl_1.0-30_all.deb) ...
Unpacking replacement libpve-common-perl ...
Preparing to replace pve-cluster 1.0-26 (using .../pve-cluster_1.0-27_amd64.deb) ...
Unpacking replacement pve-cluster ...
Preparing to replace libxml2-utils 2.7.8.dfsg-2+squeeze4 (using .../libxml2-utils_2.7.8.dfsg-2+squeeze5_amd64.deb) ...
Unpacking replacement libxml2-utils ...
Preparing to replace redhat-cluster-pve 3.1.8-3 (using .../redhat-cluster-pve_3.1.92-3_amd64.deb) ...
Unpacking replacement redhat-cluster-pve ...
Preparing to replace fence-agents-pve 3.1.7-2 (using .../fence-agents-pve_3.1.8-1_amd64.deb) ...
Unpacking replacement fence-agents-pve ...
Preparing to replace libexpat1 2.0.1-7 (using .../libexpat1_2.0.1-7+squeeze1_amd64.deb) ...
Unpacking replacement libexpat1 ...
Preparing to replace libpq5 8.4.12-0squeeze1 (using .../libpq5_8.4.13-0squeeze1_amd64.deb) ...
Unpacking replacement libpq5 ...
Preparing to replace libpve-access-control 1.0-21 (using .../libpve-access-control_1.0-24_amd64.deb) ...
Unpacking replacement libpve-access-control ...
Preparing to replace libpve-storage-perl 2.0-18 (using .../libpve-storage-perl_2.0-31_all.deb) ...
Unpacking replacement libpve-storage-perl ...
Preparing to replace pve-firmware 1.0-16 (using .../pve-firmware_1.0-18_all.deb) ...
Unpacking replacement pve-firmware ...
Preparing to replace vncterm 1.0-2 (using .../vncterm_1.0-3_amd64.deb) ...
Unpacking replacement vncterm ...
Preparing to replace pve-manager 2.1-1 (using .../pve-manager_2.1-14_all.deb) ...
Unpacking replacement pve-manager ...
Processing triggers for man-db ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Setting up isc-dhcp-common (4.1.1-P1-15+squeeze6) ...
Setting up isc-dhcp-client (4.1.1-P1-15+squeeze6) ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Setting up libkrb5support0 (1.8.3+dfsg-4squeeze6) ...
Setting up libk5crypto3 (1.8.3+dfsg-4squeeze6) ...
Setting up libkrb5-3 (1.8.3+dfsg-4squeeze6) ...
Setting up libgssapi-krb5-2 (1.8.3+dfsg-4squeeze6) ...
Setting up libxml2 (2.7.8.dfsg-2+squeeze5) ...
Setting up libisc62 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libdns69 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libisccc60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libisccfg62 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libbind9-60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up liblwres60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up bind9-host (1:9.7.3.dfsg-1~squeeze6) ...
Setting up dnsutils (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libgssrpc4 (1.8.3+dfsg-4squeeze6) ...
Setting up libkadm5clnt-mit7 (1.8.3+dfsg-4squeeze6) ...
Setting up libkdb5-4 (1.8.3+dfsg-4squeeze6) ...
Setting up libkadm5srv-mit7 (1.8.3+dfsg-4squeeze6) ...
Setting up libpve-common-perl (1.0-30) ...
Setting up pve-cluster (1.0-27) ...
Restarting pve cluster filesystem: pve-cluster.
Setting up libxml2-utils (2.7.8.dfsg-2+squeeze5) ...
Setting up redhat-cluster-pve (3.1.92-3) ...
Installing new version of config file /etc/init.d/cman ...
Installing new version of config file /etc/init.d/rgmanager ...
Configuration file `/etc/default/redhat-cluster-pve'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** redhat-cluster-pve (Y/I/N/O/D/Z) [default=N] ? D
--- /etc/default/redhat-cluster-pve 2012-02-20 14:42:40.000000000 +0100
+++ /etc/default/redhat-cluster-pve.dpkg-new 2012-06-13 16:36:53.000000000 +0200
@@ -1,8 +1,6 @@
-# CLUSTERNAME=""
-# NODENAME=""
-# USE_CCS="yes"
-# CLUSTER_JOIN_TIMEOUT=300
-# CLUSTER_JOIN_OPTIONS=""
-# CLUSTER_SHUTDOWN_TIMEOUT=60
-# RGMGR_OPTIONS=""
-FENCE_JOIN="yes"
+# this file is sourced by the following init scripts:
+# /etc/init.d/cpglockd
+# /etc/init.d/cman
+# /etc/init.d/rgmanager
+
+# FENCE_JOIN="yes"
Configuration file `/etc/default/redhat-cluster-pve'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** redhat-cluster-pve (Y/I/N/O/D/Z) [default=N] ? Y
Installing new version of config file /etc/default/redhat-cluster-pve ...
Setting up fence-agents-pve (3.1.8-1) ...
Setting up libexpat1 (2.0.1-7+squeeze1) ...
Setting up libpq5 (8.4.13-0squeeze1) ...
Setting up libpve-access-control (1.0-24) ...
Setting up libpve-storage-perl (2.0-31) ...
Setting up pve-firmware (1.0-18) ...
Setting up vncterm (1.0-3) ...
Setting up pve-manager (2.1-14) ...
Installing new version of config file /etc/apache2/sites-available/pve.conf ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Restarting PVE Daemon: pvedaemon.
Restarting PVE Status Daemon: pvestatd.
Restarting web server: apache2 ... waiting .
This morning, apt-get dist-upgrade :
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
ceph-common libio-multiplex-perl libiscsi1 librados2 librbd1
pve-kernel-2.6.32-14-pve
The following packages will be upgraded:
proxmox-ve-2.6.32 pve-qemu-kvm qemu-server
3 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 39.2 MB of archives.
After this operation, 13.9 MB of additional disk space will be used.
[...]Series of Get:
Reading changelogs...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 39.2 MB in 40s (959 kB/s)
Selecting previously deselected package librados2.
(Reading database ... 40709 files and directories currently installed.)
Unpacking librados2 (from .../librados2_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package librbd1.
Unpacking librbd1 (from .../librbd1_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package ceph-common.
Unpacking ceph-common (from .../ceph-common_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package libio-multiplex-perl.
Unpacking libio-multiplex-perl (from .../libio-multiplex-perl_1.10-1_all.deb) ...
Selecting previously deselected package libiscsi1.
Unpacking libiscsi1 (from .../libiscsi1_1.5.0-1_amd64.deb) ...
Selecting previously deselected package pve-kernel-2.6.32-14-pve.
Unpacking pve-kernel-2.6.32-14-pve (from .../pve-kernel-2.6.32-14-pve_2.6.32-74_amd64.deb) ...
Preparing to replace pve-qemu-kvm 1.0-9 (using .../pve-qemu-kvm_1.1-8_amd64.deb) ...
Unpacking replacement pve-qemu-kvm ...
Preparing to replace qemu-server 2.0-39 (using .../qemu-server_2.0-49_amd64.deb) ...
Unpacking replacement qemu-server ...
Preparing to replace proxmox-ve-2.6.32 2.1-68 (using .../proxmox-ve-2.6.32_2.1-74_all.deb) ...
Unpacking replacement proxmox-ve-2.6.32 ...
Processing triggers for man-db ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Processing triggers for pve-manager ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Restarting PVE Daemon: pvedaemon.
Restarting PVE Status Daemon: pvestatd.
Restarting web server: apache2 ... waiting .
Setting up librados2 (0.48argonaut-1~bpo60+1) ...
Setting up librbd1 (0.48argonaut-1~bpo60+1) ...
Setting up ceph-common (0.48argonaut-1~bpo60+1) ...
Setting up libio-multiplex-perl (1.10-1) ...
Setting up libiscsi1 (1.5.0-1) ...
Setting up pve-kernel-2.6.32-14-pve (2.6.32-74) ...
update-initramfs: Generating /boot/initrd.img-2.6.32-14-pve
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-2.6.32-14-pve
Found initrd image: /boot/initrd.img-2.6.32-14-pve
Found linux image: /boot/vmlinuz-2.6.32-12-pve
Found initrd image: /boot/initrd.img-2.6.32-12-pve
Found linux image: /boot/vmlinuz-2.6.32-11-pve
Found initrd image: /boot/initrd.img-2.6.32-11-pve
Found linux image: /boot/vmlinuz-2.6.32-10-pve
Found initrd image: /boot/initrd.img-2.6.32-10-pve
Found linux image: /boot/vmlinuz-2.6.32-7-pve
Found initrd image: /boot/initrd.img-2.6.32-7-pve
Found linux image: /boot/vmlinuz-2.6.32-6-pve
Found initrd image: /boot/initrd.img-2.6.32-6-pve
Found memtest86+ image: /memtest86+.bin
Found memtest86+ multiboot image: /memtest86+_multiboot.bin
done
Setting up pve-qemu-kvm (1.1-8) ...
Setting up qemu-server (2.0-49) ...
Setting up proxmox-ve-2.6.32 (2.1-74) ...
installing proxmox release key: OK
Then go for a reboot cycle on each node, starting by the ones hosting test VM.
On node 4, rgmanager does not start anymore (but service rgmanager start says [ OK ]]
On node 5, same problem...
Clustat on nodes 1, 2 and 3 is correct.
Clustat on node 4 and 5 does NOT list any rgmanager
pvecm status on nodes 4 and 5 says "Ports bound: 0" while it says "Ports Bound: 0 177" on any of the 3 other nodes.
pveversion : pve-manager/2.1/f32f3f46
Any idea?
Thanks,
Christophe.
Yesterday was update day : 5 nodes cluster, pve v2.1.
apt-get update
apt-get -y upgrade gives on each of the faive nodes :
Reading package lists...
Building dependency tree...
Reading state information...
The following packages have been kept back:
proxmox-ve-2.6.32 pve-qemu-kvm qemu-server
The following packages will be upgraded:
bind9-host dnsutils fence-agents-pve isc-dhcp-client isc-dhcp-common
libbind9-60 libdns69 libexpat1 libgssapi-krb5-2 libgssrpc4 libisc62
libisccc60 libisccfg62 libk5crypto3 libkadm5clnt-mit7 libkadm5srv-mit7
libkdb5-4 libkrb5-3 libkrb5support0 liblwres60 libpq5 libpve-access-control
libpve-common-perl libpve-storage-perl libxml2 libxml2-utils pve-cluster
pve-firmware pve-manager redhat-cluster-pve vncterm
31 upgraded, 0 newly installed, 0 to remove and 3 not upgraded.
Need to get 23.6 MB of archives.
After this operation, 659 kB of additional disk space will be used.
[...]Series of Get:
Reading changelogs...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 23.6 MB in 19s (1,236 kB/s)
(Reading database ... 40669 files and directories currently installed.)
Preparing to replace isc-dhcp-client 4.1.1-P1-15+squeeze3 (using .../isc-dhcp-client_4.1.1-P1-15+squeeze6_amd64.deb) ...
Unpacking replacement isc-dhcp-client ...
Preparing to replace isc-dhcp-common 4.1.1-P1-15+squeeze3 (using .../isc-dhcp-common_4.1.1-P1-15+squeeze6_amd64.deb) ...
Unpacking replacement isc-dhcp-common ...
Preparing to replace libk5crypto3 1.8.3+dfsg-4squeeze5 (using .../libk5crypto3_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libk5crypto3 ...
Preparing to replace libgssapi-krb5-2 1.8.3+dfsg-4squeeze5 (using .../libgssapi-krb5-2_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libgssapi-krb5-2 ...
Preparing to replace libkrb5-3 1.8.3+dfsg-4squeeze5 (using .../libkrb5-3_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkrb5-3 ...
Preparing to replace libkrb5support0 1.8.3+dfsg-4squeeze5 (using .../libkrb5support0_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkrb5support0 ...
Preparing to replace libxml2 2.7.8.dfsg-2+squeeze4 (using .../libxml2_2.7.8.dfsg-2+squeeze5_amd64.deb) ...
Unpacking replacement libxml2 ...
Preparing to replace bind9-host 1:9.7.3.dfsg-1~squeeze5 (using .../bind9-host_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement bind9-host ...
Preparing to replace dnsutils 1:9.7.3.dfsg-1~squeeze5 (using .../dnsutils_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement dnsutils ...
Preparing to replace libisc62 1:9.7.3.dfsg-1~squeeze5 (using .../libisc62_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisc62 ...
Preparing to replace libdns69 1:9.7.3.dfsg-1~squeeze5 (using .../libdns69_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libdns69 ...
Preparing to replace libisccc60 1:9.7.3.dfsg-1~squeeze5 (using .../libisccc60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisccc60 ...
Preparing to replace libisccfg62 1:9.7.3.dfsg-1~squeeze5 (using .../libisccfg62_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libisccfg62 ...
Preparing to replace liblwres60 1:9.7.3.dfsg-1~squeeze5 (using .../liblwres60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement liblwres60 ...
Preparing to replace libbind9-60 1:9.7.3.dfsg-1~squeeze5 (using .../libbind9-60_1%3a9.7.3.dfsg-1~squeeze6_amd64.deb) ...
Unpacking replacement libbind9-60 ...
Preparing to replace libgssrpc4 1.8.3+dfsg-4squeeze5 (using .../libgssrpc4_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libgssrpc4 ...
Preparing to replace libkadm5clnt-mit7 1.8.3+dfsg-4squeeze5 (using .../libkadm5clnt-mit7_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkadm5clnt-mit7 ...
Preparing to replace libkdb5-4 1.8.3+dfsg-4squeeze5 (using .../libkdb5-4_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkdb5-4 ...
Preparing to replace libkadm5srv-mit7 1.8.3+dfsg-4squeeze5 (using .../libkadm5srv-mit7_1.8.3+dfsg-4squeeze6_amd64.deb) ...
Unpacking replacement libkadm5srv-mit7 ...
Preparing to replace libpve-common-perl 1.0-27 (using .../libpve-common-perl_1.0-30_all.deb) ...
Unpacking replacement libpve-common-perl ...
Preparing to replace pve-cluster 1.0-26 (using .../pve-cluster_1.0-27_amd64.deb) ...
Unpacking replacement pve-cluster ...
Preparing to replace libxml2-utils 2.7.8.dfsg-2+squeeze4 (using .../libxml2-utils_2.7.8.dfsg-2+squeeze5_amd64.deb) ...
Unpacking replacement libxml2-utils ...
Preparing to replace redhat-cluster-pve 3.1.8-3 (using .../redhat-cluster-pve_3.1.92-3_amd64.deb) ...
Unpacking replacement redhat-cluster-pve ...
Preparing to replace fence-agents-pve 3.1.7-2 (using .../fence-agents-pve_3.1.8-1_amd64.deb) ...
Unpacking replacement fence-agents-pve ...
Preparing to replace libexpat1 2.0.1-7 (using .../libexpat1_2.0.1-7+squeeze1_amd64.deb) ...
Unpacking replacement libexpat1 ...
Preparing to replace libpq5 8.4.12-0squeeze1 (using .../libpq5_8.4.13-0squeeze1_amd64.deb) ...
Unpacking replacement libpq5 ...
Preparing to replace libpve-access-control 1.0-21 (using .../libpve-access-control_1.0-24_amd64.deb) ...
Unpacking replacement libpve-access-control ...
Preparing to replace libpve-storage-perl 2.0-18 (using .../libpve-storage-perl_2.0-31_all.deb) ...
Unpacking replacement libpve-storage-perl ...
Preparing to replace pve-firmware 1.0-16 (using .../pve-firmware_1.0-18_all.deb) ...
Unpacking replacement pve-firmware ...
Preparing to replace vncterm 1.0-2 (using .../vncterm_1.0-3_amd64.deb) ...
Unpacking replacement vncterm ...
Preparing to replace pve-manager 2.1-1 (using .../pve-manager_2.1-14_all.deb) ...
Unpacking replacement pve-manager ...
Processing triggers for man-db ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Setting up isc-dhcp-common (4.1.1-P1-15+squeeze6) ...
Setting up isc-dhcp-client (4.1.1-P1-15+squeeze6) ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Setting up libkrb5support0 (1.8.3+dfsg-4squeeze6) ...
Setting up libk5crypto3 (1.8.3+dfsg-4squeeze6) ...
Setting up libkrb5-3 (1.8.3+dfsg-4squeeze6) ...
Setting up libgssapi-krb5-2 (1.8.3+dfsg-4squeeze6) ...
Setting up libxml2 (2.7.8.dfsg-2+squeeze5) ...
Setting up libisc62 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libdns69 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libisccc60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libisccfg62 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libbind9-60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up liblwres60 (1:9.7.3.dfsg-1~squeeze6) ...
Setting up bind9-host (1:9.7.3.dfsg-1~squeeze6) ...
Setting up dnsutils (1:9.7.3.dfsg-1~squeeze6) ...
Setting up libgssrpc4 (1.8.3+dfsg-4squeeze6) ...
Setting up libkadm5clnt-mit7 (1.8.3+dfsg-4squeeze6) ...
Setting up libkdb5-4 (1.8.3+dfsg-4squeeze6) ...
Setting up libkadm5srv-mit7 (1.8.3+dfsg-4squeeze6) ...
Setting up libpve-common-perl (1.0-30) ...
Setting up pve-cluster (1.0-27) ...
Restarting pve cluster filesystem: pve-cluster.
Setting up libxml2-utils (2.7.8.dfsg-2+squeeze5) ...
Setting up redhat-cluster-pve (3.1.92-3) ...
Installing new version of config file /etc/init.d/cman ...
Installing new version of config file /etc/init.d/rgmanager ...
Configuration file `/etc/default/redhat-cluster-pve'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** redhat-cluster-pve (Y/I/N/O/D/Z) [default=N] ? D
--- /etc/default/redhat-cluster-pve 2012-02-20 14:42:40.000000000 +0100
+++ /etc/default/redhat-cluster-pve.dpkg-new 2012-06-13 16:36:53.000000000 +0200
@@ -1,8 +1,6 @@
-# CLUSTERNAME=""
-# NODENAME=""
-# USE_CCS="yes"
-# CLUSTER_JOIN_TIMEOUT=300
-# CLUSTER_JOIN_OPTIONS=""
-# CLUSTER_SHUTDOWN_TIMEOUT=60
-# RGMGR_OPTIONS=""
-FENCE_JOIN="yes"
+# this file is sourced by the following init scripts:
+# /etc/init.d/cpglockd
+# /etc/init.d/cman
+# /etc/init.d/rgmanager
+
+# FENCE_JOIN="yes"
Configuration file `/etc/default/redhat-cluster-pve'
==> Modified (by you or by a script) since installation.
==> Package distributor has shipped an updated version.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : start a shell to examine the situation
The default action is to keep your current version.
*** redhat-cluster-pve (Y/I/N/O/D/Z) [default=N] ? Y
Installing new version of config file /etc/default/redhat-cluster-pve ...
Setting up fence-agents-pve (3.1.8-1) ...
Setting up libexpat1 (2.0.1-7+squeeze1) ...
Setting up libpq5 (8.4.13-0squeeze1) ...
Setting up libpve-access-control (1.0-24) ...
Setting up libpve-storage-perl (2.0-31) ...
Setting up pve-firmware (1.0-18) ...
Setting up vncterm (1.0-3) ...
Setting up pve-manager (2.1-14) ...
Installing new version of config file /etc/apache2/sites-available/pve.conf ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Restarting PVE Daemon: pvedaemon.
Restarting PVE Status Daemon: pvestatd.
Restarting web server: apache2 ... waiting .
This morning, apt-get dist-upgrade :
Reading package lists...
Building dependency tree...
Reading state information...
The following NEW packages will be installed:
ceph-common libio-multiplex-perl libiscsi1 librados2 librbd1
pve-kernel-2.6.32-14-pve
The following packages will be upgraded:
proxmox-ve-2.6.32 pve-qemu-kvm qemu-server
3 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 39.2 MB of archives.
After this operation, 13.9 MB of additional disk space will be used.
[...]Series of Get:
Reading changelogs...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
Fetched 39.2 MB in 40s (959 kB/s)
Selecting previously deselected package librados2.
(Reading database ... 40709 files and directories currently installed.)
Unpacking librados2 (from .../librados2_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package librbd1.
Unpacking librbd1 (from .../librbd1_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package ceph-common.
Unpacking ceph-common (from .../ceph-common_0.48argonaut-1~bpo60+1_amd64.deb) ...
Selecting previously deselected package libio-multiplex-perl.
Unpacking libio-multiplex-perl (from .../libio-multiplex-perl_1.10-1_all.deb) ...
Selecting previously deselected package libiscsi1.
Unpacking libiscsi1 (from .../libiscsi1_1.5.0-1_amd64.deb) ...
Selecting previously deselected package pve-kernel-2.6.32-14-pve.
Unpacking pve-kernel-2.6.32-14-pve (from .../pve-kernel-2.6.32-14-pve_2.6.32-74_amd64.deb) ...
Preparing to replace pve-qemu-kvm 1.0-9 (using .../pve-qemu-kvm_1.1-8_amd64.deb) ...
Unpacking replacement pve-qemu-kvm ...
Preparing to replace qemu-server 2.0-39 (using .../qemu-server_2.0-49_amd64.deb) ...
Unpacking replacement qemu-server ...
Preparing to replace proxmox-ve-2.6.32 2.1-68 (using .../proxmox-ve-2.6.32_2.1-74_all.deb) ...
Unpacking replacement proxmox-ve-2.6.32 ...
Processing triggers for man-db ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Processing triggers for pve-manager ...
debconf: unable to initialize frontend: Dialog
debconf: (TERM is not set, so the dialog frontend is not usable.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
Restarting PVE Daemon: pvedaemon.
Restarting PVE Status Daemon: pvestatd.
Restarting web server: apache2 ... waiting .
Setting up librados2 (0.48argonaut-1~bpo60+1) ...
Setting up librbd1 (0.48argonaut-1~bpo60+1) ...
Setting up ceph-common (0.48argonaut-1~bpo60+1) ...
Setting up libio-multiplex-perl (1.10-1) ...
Setting up libiscsi1 (1.5.0-1) ...
Setting up pve-kernel-2.6.32-14-pve (2.6.32-74) ...
update-initramfs: Generating /boot/initrd.img-2.6.32-14-pve
Generating grub.cfg ...
Found linux image: /boot/vmlinuz-2.6.32-14-pve
Found initrd image: /boot/initrd.img-2.6.32-14-pve
Found linux image: /boot/vmlinuz-2.6.32-12-pve
Found initrd image: /boot/initrd.img-2.6.32-12-pve
Found linux image: /boot/vmlinuz-2.6.32-11-pve
Found initrd image: /boot/initrd.img-2.6.32-11-pve
Found linux image: /boot/vmlinuz-2.6.32-10-pve
Found initrd image: /boot/initrd.img-2.6.32-10-pve
Found linux image: /boot/vmlinuz-2.6.32-7-pve
Found initrd image: /boot/initrd.img-2.6.32-7-pve
Found linux image: /boot/vmlinuz-2.6.32-6-pve
Found initrd image: /boot/initrd.img-2.6.32-6-pve
Found memtest86+ image: /memtest86+.bin
Found memtest86+ multiboot image: /memtest86+_multiboot.bin
done
Setting up pve-qemu-kvm (1.1-8) ...
Setting up qemu-server (2.0-49) ...
Setting up proxmox-ve-2.6.32 (2.1-74) ...
installing proxmox release key: OK
Then go for a reboot cycle on each node, starting by the ones hosting test VM.
On node 4, rgmanager does not start anymore (but service rgmanager start says [ OK ]]
On node 5, same problem...
Clustat on nodes 1, 2 and 3 is correct.
Clustat on node 4 and 5 does NOT list any rgmanager
pvecm status on nodes 4 and 5 says "Ports bound: 0" while it says "Ports Bound: 0 177" on any of the 3 other nodes.
pveversion : pve-manager/2.1/f32f3f46
Any idea?
Thanks,
Christophe.
