Connection timeout by checking "summary" of the node

xtavras

Renowned Member
Jun 29, 2015
31
2
73
Berlin
I have strange problem with our cluster. Cluster works fine, no issues, I can migrate VM between each node without issues for example. I have 5 nodes from prx01 to prx05. If I login to prx02 and try to see "Summary" page of prx05 or open console on VM running on prx05 I will get "Connection timeout". If I login to prx05 and try to do the same on prx02 node I get same timeout. But it does work if I check summary of other node. If I login to prx01 I can see summary of all nodes in the cluster without any issues.
I've tried different browsers as well as did my colleague.
It's really strange like there is something wrong with prx02 and prx05 because our backup solution has failing jobs and only on two these nodes, but I don't know where to look exactly. I only found this error in "pvedaemon" log. Any ideas what to check?

Code:
 VM 123 qmp command failed - VM 123 qmp command 'guest-ping' failed - got timeout

Code:
prx02:~# pvecm status
Cluster information
-------------------
Name:             COLONG
Config Version:   15
Transport:        knet
Secure auth:      on

Quorum information
------------------
Date:             Wed Oct 16 15:55:03 2024
Quorum provider:  corosync_votequorum
Nodes:            5
Node ID:          0x00000002
Ring ID:          1.196b
Quorate:          Yes

Votequorum information
----------------------
Expected votes:   5
Highest expected: 5
Total votes:      5
Quorum:           3
Flags:            Quorate

Membership information
----------------------
    Nodeid      Votes Name
0x00000001          1 10.10.1.66
0x00000002          1 10.10.1.204 (local)
0x00000003          1 10.10.1.77
0x00000004          1 10.10.1.78
0x00000005          1 10.10.1.161


Code:
prx02:~# pveversion -v
proxmox-ve: 8.2.0 (running kernel: 6.8.12-2-pve)
pve-manager: 8.2.7 (running version: 8.2.7/3e0176e6bb2ade3b)
proxmox-kernel-helper: 8.1.0
pve-kernel-5.15: 7.4-7
proxmox-kernel-6.8: 6.8.12-2
proxmox-kernel-6.8.12-2-pve-signed: 6.8.12-2
proxmox-kernel-6.5.13-6-pve-signed: 6.5.13-6
proxmox-kernel-6.5: 6.5.13-6
proxmox-kernel-6.5.11-8-pve-signed: 6.5.11-8
proxmox-kernel-6.5.11-7-pve-signed: 6.5.11-7
pve-kernel-5.15.126-1-pve: 5.15.126-1
pve-kernel-5.4.174-2-pve: 5.4.174-2
pve-kernel-4.10.17-3-pve: 4.10.17-23
pve-kernel-4.10.17-2-pve: 4.10.17-20
ceph-fuse: 16.2.11+ds-2
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown: residual config
ifupdown2: 3.2.0-1+pmx9
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.1
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.4
libpve-access-control: 8.1.4
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.7
libpve-cluster-perl: 8.0.7
libpve-common-perl: 8.2.3
libpve-guest-common-perl: 5.1.4
libpve-http-server-perl: 5.1.1
libpve-network-perl: 0.9.8
libpve-rs-perl: 0.8.10
libpve-storage-perl: 8.2.5
libqb0: 1.0.5-1
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.4.0-4
proxmox-backup-client: 3.2.7-1
proxmox-backup-file-restore: 3.2.7-1
proxmox-firewall: 0.5.0
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.2.3
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.2.3
pve-cluster: 8.0.7
pve-container: 5.2.0
pve-docs: 8.2.3
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.0.7
pve-firmware: 3.13-2
pve-ha-manager: 4.0.5
pve-i18n: 3.2.3
pve-qemu-kvm: 8.1.5-6
pve-xtermjs: 5.3.0-3
qemu-server: 8.2.4
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.6-pve1
 

Attachments

  • proxmox01.png
    proxmox01.png
    180.7 KB · Views: 2
Last edited: