Migration to another host fails

L

lightnet-barry

Active Member
Feb 7, 2017
19
2
43
Certain VMs fail to migrate to a particular host in my cluster.
The migration managed by HA appears to be successful with a Start on the destination but the the following message is recorded in syslog and the VM is migrated away again (not always to original source)
Jan 25 23:41:52 HaPVEamax4 systemd-udevd[38920]: Using default interface naming scheme 'v240'. Jan 25 23:41:52 HaPVEamax4 systemd-udevd[38920]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Jan 25 23:41:52 HaPVEamax4 systemd-udevd[38920]: Could not generate persistent MAC address for tap125i0: No such file or directory

I can see no difference in interface configuration on VMs which succeed or fail to migrate to this node.
Any pointers appreciated
 
Those have nothing to do with the issue.
Please provide more information about your cluster and the HA config:
  • pveversion -v
  • cat /etc/pve/ha/resources.cfg
  • qm config <VMID>(of the VM in question)
  • task log of the migration and the migration back
  • journal/syslog for that time
 
Hi Mira,

One thing I notice which I may have missed last night is:
kvm: warning: TSC frequency mismatch between VM (2399997 kHz) and host (2099998 kHz), and TSC scaling unavailable on the destination node.

pveversions -v
proxmox-ve: 6.4-1 (running kernel: 5.4.162-1-pve)
pve-manager: 6.4-13 (running version: 6.4-13/9f411e79)
pve-kernel-5.4: 6.4-12
pve-kernel-helper: 6.4-12
pve-kernel-5.4.162-1-pve: 5.4.162-2
pve-kernel-5.4.78-2-pve: 5.4.78-2
pve-kernel-4.15: 5.4-19
pve-kernel-4.15.18-30-pve: 4.15.18-58
pve-kernel-4.15.18-16-pve: 4.15.18-41
pve-kernel-4.4.134-1-pve: 4.4.134-112
pve-kernel-4.4.83-1-pve: 4.4.83-96
pve-kernel-4.2.6-1-pve: 4.2.6-36
ceph: 14.2.22-pve1
ceph-fuse: 14.2.22-pve1
corosync: 3.1.5-pve2~bpo10+1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.22-pve2~bpo10+1
libproxmox-acme-perl: 1.1.0
libproxmox-backup-qemu0: 1.1.0-1
libpve-access-control: 6.4-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.4-4
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.2-3
libpve-storage-perl: 6.4-1
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.1.13-2
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.6-1
pve-cluster: 6.4-1
pve-container: 3.3-6
pve-docs: 6.4-2
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-4
pve-firmware: 3.3-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-6
pve-xtermjs: 4.7.0-3
qemu-server: 6.4-2
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.7-pve1
Click to expand...
cat /etc/pve/ha/resources.cfg
...
vm: 125
comment Freeradius
group HA1
state started
Click to expand...

qm config
bootdisk: ide0
cores: 4
cpu: kvm64,flags=+pcid;+spec-ctrl;+ssbd
description: IP address = 172.xx.xxx.xx%0AOS = Debian 8.6
ide0: sdfpoolRBD:vm-125-disk-0,size=64G
ide2: none,media=cdrom
memory: 8192
name: Freeradius
net0: e1000=36:35:63:61:30:63,bridge=vmbr0
numa: 0
onboot: 1
ostype: l26
smbios1: uuid=7934f9a4-c01a-47ca-bcac-6bed89c0535d
sockets: 1
Click to expand...
task logs
task started by HA resource agent
2022-01-26 12:07:23 use dedicated network address for sending migration traffic (172.xx.xx.xx4)
2022-01-26 12:07:23 starting migration of VM 125 to node 'HaPVEamax4' (172.xx.xx.xx4)
2022-01-26 12:07:23 starting VM 125 on remote node 'HaPVEamax4'
2022-01-26 12:07:26 start remote tunnel
2022-01-26 12:07:26 ssh tunnel ver 1
2022-01-26 12:07:26 starting online/live migration on tcp:172.xx.xxx.xx4:60000
2022-01-26 12:07:26 set migration capabilities
2022-01-26 12:07:26 migration downtime limit: 100 ms
2022-01-26 12:07:26 migration cachesize: 1.0 GiB
2022-01-26 12:07:26 set migration parameters
2022-01-26 12:07:26 start migrate command to tcp:172.xx.xx.xx4:60000
2022-01-26 12:07:27 migration active, transferred 351.1 MiB of 8.0 GiB VM-state, 7.7 GiB/s
2022-01-26 12:07:28 migration active, transferred 718.0 MiB of 8.0 GiB VM-state, 712.5 MiB/s
2022-01-26 12:07:29 average migration speed: 2.7 GiB/s - downtime 58 ms
2022-01-26 12:07:29 migration status: completed
2022-01-26 12:07:32 migration finished successfully (duration 00:00:09)
TASK OK
Click to expand...
migration listens on tcp:172.xx.xxx.xx4:60000
TASK OK
Click to expand...
task started by HA resource agent
2022-01-26 12:07:46 use dedicated network address for sending migration traffic (172.xx.xxx.xx3)
2022-01-26 12:07:46 starting migration of VM 125 to node 'HaPVEamax3' (172.xx.xxx.xx3)
2022-01-26 12:07:46 starting VM 125 on remote node 'HaPVEamax3'
2022-01-26 12:07:48 start remote tunnel
2022-01-26 12:07:49 ssh tunnel ver 1
2022-01-26 12:07:49 starting online/live migration on tcp:172.xx.xxx.xx3:60000
2022-01-26 12:07:49 set migration capabilities
2022-01-26 12:07:49 migration downtime limit: 100 ms
2022-01-26 12:07:49 migration cachesize: 1.0 GiB
2022-01-26 12:07:49 set migration parameters
2022-01-26 12:07:49 start migrate command to tcp:172.xx.xxx.xx3:60000
2022-01-26 12:07:50 migration active, transferred 354.2 MiB of 8.0 GiB VM-state, 7.9 GiB/s
2022-01-26 12:07:51 average migration speed: 4.0 GiB/s - downtime 71 ms
2022-01-26 12:07:51 migration status: completed
2022-01-26 12:07:54 migration finished successfully (duration 00:00:08)
TASK OK
Click to expand...
migration listens on tcp:172.xx.xxx.003:60000
TASK OK
Click to expand...
 
Last edited:
syslog
Node 3 syslog
Jan 26 12:07:19 HaPVEamax3 pvedaemon[1666]: <barry@pve> starting task UPID:HaPVEamax3:0005E7C0:004615B6:61F13977:hamigrate:125:barry@pve:
Jan 26 12:07:19 HaPVEamax3 pvedaemon[1666]: <barry@pve> end task UPID:HaPVEamax3:0005E7C0:004615B6:61F13977:hamigrate:125:barry@pve: OK
Jan 26 12:07:22 HaPVEamax3 pve-ha-lrm[387013]: <root@pam> starting task UPID:HaPVEamax3:0005E7C9:0046172C:61F1397A:qmigrate:125:root@pam:
Jan 26 12:07:24 HaPVEamax3 pmxcfs[1426]: [status] notice: received log
Jan 26 12:07:26 HaPVEamax3 pmxcfs[1426]: [status] notice: received log
Jan 26 12:07:27 HaPVEamax3 pve-ha-lrm[387013]: Task 'UPID:HaPVEamax3:0005E7C9:0046172C:61F1397A:qmigrate:125:root@pam:' still active, waiting
Jan 26 12:07:31 HaPVEamax3 kernel: vmbr0: port 5(tap125i0) entered disabled state
Jan 26 12:07:31 HaPVEamax3 qmeventd[983]: read: Connection reset by peer
Jan 26 12:07:31 HaPVEamax3 systemd[1]: 125.scope: Succeeded.
Jan 26 12:07:32 HaPVEamax3 pve-ha-lrm[387013]: Task 'UPID:HaPVEamax3:0005E7C9:0046172C:61F1397A:qmigrate:125:root@pam:' still active, waiting
Jan 26 12:07:32 HaPVEamax3 pve-ha-lrm[387013]: <root@pam> end task UPID:HaPVEamax3:0005E7C9:0046172C:61F1397A:qmigrate:125:root@pam: OK
Jan 26 12:07:40 HaPVEamax3 pmxcfs[1426]: [status] notice: received log
Jan 26 12:07:45 HaPVEamax3 pmxcfs[1426]: [status] notice: received log
Jan 26 12:07:45 HaPVEamax3 sshd[387199]: Accepted publickey for root from 172.xx.xxx.xx4 port 47020 ssh2: RSA SHA256:+qkguMiGk
Jan 26 12:07:45 HaPVEamax3 sshd[387199]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:45 HaPVEamax3 systemd-logind[989]: New session 104 of user root.
Jan 26 12:07:45 HaPVEamax3 systemd[1]: Started Session 104 of user root.
Jan 26 12:07:46 HaPVEamax3 sshd[387199]: Received disconnect from 172.xx.xxx.xx4 port 47020:11: disconnected by user
Jan 26 12:07:46 HaPVEamax3 sshd[387199]: Disconnected from user root 172.xx.xxx.xx4 port 47020
Jan 26 12:07:46 HaPVEamax3 sshd[387199]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:46 HaPVEamax3 systemd[1]: session-104.scope: Succeeded.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Session 104 logged out. Waiting for processes to exit.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Removed session 104.
Jan 26 12:07:46 HaPVEamax3 sshd[387213]: Accepted publickey for root from 172.xx.xxx.xx4 port 47022 ssh2: RSA SHA256:qkguMiGk
Jan 26 12:07:46 HaPVEamax3 sshd[387213]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: New session 105 of user root.
Jan 26 12:07:46 HaPVEamax3 systemd[1]: Started Session 105 of user root.
Jan 26 12:07:46 HaPVEamax3 sshd[387213]: Received disconnect from 172.xx.xxx.xx4 port 47022:11: disconnected by user
Jan 26 12:07:46 HaPVEamax3 sshd[387213]: Disconnected from user root 172.xx.xxx.xx4 port 47022
Jan 26 12:07:46 HaPVEamax3 sshd[387213]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:46 HaPVEamax3 systemd[1]: session-105.scope: Succeeded.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Session 105 logged out. Waiting for processes to exit.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Removed session 105.
Jan 26 12:07:46 HaPVEamax3 sshd[387224]: Accepted publickey for root from 172.xx.xxx.xx4 port 47024 ssh2: RSA SHA256:+qkguMiGk
Jan 26 12:07:46 HaPVEamax3 sshd[387224]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: New session 106 of user root.
Jan 26 12:07:46 HaPVEamax3 systemd[1]: Started Session 106 of user root.
Jan 26 12:07:46 HaPVEamax3 sshd[387224]: Received disconnect from 172.xx.xxx.xx4 port 47024:11: disconnected by user
Jan 26 12:07:46 HaPVEamax3 sshd[387224]: Disconnected from user root 172.xx.xxx.xx4 port 47024
Jan 26 12:07:46 HaPVEamax3 sshd[387224]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:46 HaPVEamax3 systemd[1]: session-106.scope: Succeeded.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Session 106 logged out. Waiting for processes to exit.
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: Removed session 106.
Jan 26 12:07:46 HaPVEamax3 sshd[387232]: Accepted publickey for root from 172.xx.xxx.xx4 port 47026 ssh2: RSA SHA256:+qkguMiGk
Jan 26 12:07:46 HaPVEamax3 sshd[387232]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:46 HaPVEamax3 systemd-logind[989]: New session 107 of user root.
Jan 26 12:07:46 HaPVEamax3 systemd[1]: Started Session 107 of user root.
Jan 26 12:07:47 HaPVEamax3 qm[387239]: <root@pam> starting task UPID:HaPVEamax3:0005E8F3:004620B8:61F13993:qmstart:125:root@pam:
Jan 26 12:07:47 HaPVEamax3 qm[387315]: start VM 125: UPID:HaPVEamax3:0005E8F3:004620B8:61F13993:qmstart:125:root@pam:
Jan 26 12:07:47 HaPVEamax3 systemd[1]: Started 125.scope.
Jan 26 12:07:47 HaPVEamax3 systemd-udevd[387218]: Using default interface naming scheme 'v240'.
Jan 26 12:07:47 HaPVEamax3 systemd-udevd[387218]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 26 12:07:47 HaPVEamax3 systemd-udevd[387218]: Could not generate persistent MAC address for tap125i0: No such file or directory
Jan 26 12:07:48 HaPVEamax3 kernel: device tap125i0 entered promiscuous mode
Jan 26 12:07:48 HaPVEamax3 kernel: vmbr0: port 5(tap125i0) entered blocking state
Jan 26 12:07:48 HaPVEamax3 kernel: vmbr0: port 5(tap125i0) entered disabled state
Jan 26 12:07:48 HaPVEamax3 kernel: vmbr0: port 5(tap125i0) entered blocking state
Jan 26 12:07:48 HaPVEamax3 kernel: vmbr0: port 5(tap125i0) entered forwarding state
Jan 26 12:07:48 HaPVEamax3 qm[387239]: <root@pam> end task UPID:HaPVEamax3:0005E8F3:004620B8:61F13993:qmstart:125:root@pam: OK
Jan 26 12:07:48 HaPVEamax3 sshd[387232]: Received disconnect from 172.xx.xxx.xx4 port 47026:11: disconnected by user
Jan 26 12:07:48 HaPVEamax3 sshd[387232]: Disconnected from user root 172.xx.xxx.xx4 port 47026
Jan 26 12:07:48 HaPVEamax3 sshd[387232]: pam_unix(sshd:session): session closed for user root
Click to expand...
 
Node 4 syslog
Jan 26 12:07:19 HaPVEamax4 pve-ha-crm[1888]: got crm command: migrate vm:125 HaPVEamax4
Jan 26 12:07:19 HaPVEamax4 pve-ha-crm[1888]: migrate service 'vm:125' to node 'HaPVEamax4'
Jan 26 12:07:19 HaPVEamax4 pve-ha-crm[1888]: service 'vm:125': state changed from 'started' to 'migrate' (node = HaPVEamax3, target = HaPVEamax4)
Jan 26 12:07:22 HaPVEamax4 pmxcfs[1516]: [status] notice: received log
Jan 26 12:07:22 HaPVEamax4 sshd[562094]: Accepted publickey for root from 172.xx.xxx.xx3 port 49850 ssh2: RSA SHA256:6vUtUth/upRjc
Jan 26 12:07:22 HaPVEamax4 sshd[562094]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Created slice User Slice of UID 0.
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Starting User Runtime Directory /run/user/0...
Jan 26 12:07:22 HaPVEamax4 systemd-logind[1142]: New session 102 of user root.
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Started User Runtime Directory /run/user/0.
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Starting User Manager for UID 0...
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: pam_unix(systemd-user:session): session opened for user root by (uid=0)
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on GnuPG cryptographic agent (ssh-agent emulation).
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on GnuPG cryptographic agent and passphrase cache (restricted).
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on GnuPG cryptographic agent and passphrase cache.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Reached target Timers.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Starting D-Bus User Message Bus Socket.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on GnuPG network certificate management daemon.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on GnuPG cryptographic agent and passphrase cache (access for web browsers).
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Reached target Paths.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Listening on D-Bus User Message Bus Socket.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Reached target Sockets.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Reached target Basic System.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Reached target Default.
Jan 26 12:07:22 HaPVEamax4 systemd[562103]: Startup finished in 82ms.
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Started User Manager for UID 0.
Jan 26 12:07:22 HaPVEamax4 systemd[1]: Started Session 102 of user root.
Jan 26 12:07:23 HaPVEamax4 sshd[562094]: Received disconnect from 172.xx.xxx.xx3 port 49850:11: disconnected by user
Jan 26 12:07:23 HaPVEamax4 sshd[562094]: Disconnected from user root 172.xx.xxx.xx3 port 49850
Jan 26 12:07:23 HaPVEamax4 sshd[562094]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:23 HaPVEamax4 systemd[1]: session-102.scope: Succeeded.
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Session 102 logged out. Waiting for processes to exit.
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Removed session 102.
Jan 26 12:07:23 HaPVEamax4 sshd[562124]: Accepted publickey for root from 172.xx.xxx.xx3 port 49852 ssh2: RSA SHA256:vUtUth/upRjc
Jan 26 12:07:23 HaPVEamax4 sshd[562124]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: New session 104 of user root.
Jan 26 12:07:23 HaPVEamax4 systemd[1]: Started Session 104 of user root.
Jan 26 12:07:23 HaPVEamax4 sshd[562124]: Received disconnect from 172.xx.xxx.xx3 port 49852:11: disconnected by user
Jan 26 12:07:23 HaPVEamax4 sshd[562124]: Disconnected from user root 172.xx.xxx.xx3 port 49852
Jan 26 12:07:23 HaPVEamax4 sshd[562124]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Session 104 logged out. Waiting for processes to exit.
Jan 26 12:07:23 HaPVEamax4 systemd[1]: session-104.scope: Succeeded.
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Removed session 104.
Jan 26 12:07:23 HaPVEamax4 sshd[562132]: Accepted publickey for root from 172.xx.xxx.xx3 port 49854 ssh2: RSA SHA256:tUth/upRjc
Jan 26 12:07:23 HaPVEamax4 sshd[562132]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: New session 105 of user root.
Jan 26 12:07:23 HaPVEamax4 systemd[1]: Started Session 105 of user root.
Jan 26 12:07:23 HaPVEamax4 sshd[562132]: Received disconnect from 172.xx.xxx.xx3 port 49854:11: disconnected by user
Jan 26 12:07:23 HaPVEamax4 sshd[562132]: Disconnected from user root 172.xx.xxx.xx3 port 49854
Jan 26 12:07:23 HaPVEamax4 sshd[562132]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:23 HaPVEamax4 systemd[1]: session-105.scope: Succeeded.
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Session 105 logged out. Waiting for processes to exit.
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: Removed session 105.
Jan 26 12:07:23 HaPVEamax4 sshd[562139]: Accepted publickey for root from 172.xx.xxx.xx3 port 49856 ssh2: RSA SHA256:tUth/upRjc
Jan 26 12:07:23 HaPVEamax4 sshd[562139]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:23 HaPVEamax4 systemd-logind[1142]: New session 106 of user root.
Jan 26 12:07:23 HaPVEamax4 systemd[1]: Started Session 106 of user root.
Jan 26 12:07:24 HaPVEamax4 qm[562148]: <root@pam> starting task UPID:HaPVEamax4:000893E5:0048ED0F:61F1397C:qmstart:125:root@pam:
Jan 26 12:07:24 HaPVEamax4 qm[562149]: start VM 125: UPID:HaPVEamax4:000893E5:0048ED0F:61F1397C:qmstart:125:root@pam:
Jan 26 12:07:24 HaPVEamax4 systemd[1]: Started 125.scope.
Jan 26 12:07:25 HaPVEamax4 systemd-udevd[562105]: Using default interface naming scheme 'v240'.
Jan 26 12:07:25 HaPVEamax4 systemd-udevd[562105]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 26 12:07:25 HaPVEamax4 systemd-udevd[562105]: Could not generate persistent MAC address for tap125i0: No such file or directory
Jan 26 12:07:25 HaPVEamax4 kernel: device tap125i0 entered promiscuous mode
Jan 26 12:07:25 HaPVEamax4 kernel: vmbr0: port 18(tap125i0) entered blocking state
Jan 26 12:07:25 HaPVEamax4 kernel: vmbr0: port 18(tap125i0) entered disabled state
Jan 26 12:07:25 HaPVEamax4 kernel: vmbr0: port 18(tap125i0) entered blocking state
Jan 26 12:07:25 HaPVEamax4 kernel: vmbr0: port 18(tap125i0) entered forwarding state
Jan 26 12:07:26 HaPVEamax4 qm[562148]: <root@pam> end task UPID:HaPVEamax4:000893E5:0048ED0F:61F1397C:qmstart:125:root@pam: OK
Jan 26 12:07:26 HaPVEamax4 sshd[562139]: Received disconnect from 172.xx.xxx.xx3 port 49856:11: disconnected by user
Jan 26 12:07:26 HaPVEamax4 sshd[562139]: Disconnected from user root 172.xx.xxx.xx3 port 49856
Jan 26 12:07:26 HaPVEamax4 sshd[562139]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:26 HaPVEamax4 systemd[1]: session-106.scope: Succeeded.
Jan 26 12:07:26 HaPVEamax4 systemd-logind[1142]: Session 106 logged out. Waiting for processes to exit.
Jan 26 12:07:26 HaPVEamax4 systemd-logind[1142]: Removed session 106.
Jan 26 12:07:26 HaPVEamax4 sshd[562217]: Accepted publickey for root from 172.xx.xxx.xx3 port 49858 ssh2: RSA SHA256:/upRjc
Jan 26 12:07:26 HaPVEamax4 sshd[562217]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:26 HaPVEamax4 systemd-logind[1142]: New session 107 of user root.
Jan 26 12:07:26 HaPVEamax4 systemd[1]: Started Session 107 of user root.
Jan 26 12:07:29 HaPVEamax4 QEMU[562159]: kvm: warning: TSC frequency mismatch between VM (2399997 kHz) and host (2099998 kHz), and TSC scaling unavailable
Jan 26 12:07:29 HaPVEamax4 QEMU[562159]: kvm: warning: TSC frequency mismatch between VM (2399997 kHz) and host (2099998 kHz), and TSC scaling unavailable
Jan 26 12:07:30 HaPVEamax4 sshd[562217]: Received disconnect from 172.xx.xxx.xx3 port 49858:11: disconnected by user
Jan 26 12:07:30 HaPVEamax4 sshd[562217]: Disconnected from user root 172.xx.xxx.xx3 port 49858
Jan 26 12:07:30 HaPVEamax4 sshd[562217]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:30 HaPVEamax4 systemd[1]: session-107.scope: Succeeded.
Jan 26 12:07:30 HaPVEamax4 systemd-logind[1142]: Session 107 logged out. Waiting for processes to exit.
Jan 26 12:07:30 HaPVEamax4 systemd-logind[1142]: Removed session 107.
Jan 26 12:07:32 HaPVEamax4 sshd[562338]: Accepted publickey for root from 172.xx.xxx.xx3 port 49886 ssh2: RSA SHA256:/upRjc
Jan 26 12:07:32 HaPVEamax4 sshd[562338]: pam_unix(sshd:session): session opened for user root by (uid=0)
Jan 26 12:07:32 HaPVEamax4 systemd-logind[1142]: New session 108 of user root.
Jan 26 12:07:32 HaPVEamax4 systemd[1]: Started Session 108 of user root.
Jan 26 12:07:32 HaPVEamax4 sshd[562338]: Received disconnect from 172.xx.xxx.xx3 port 49886:11: disconnected by user
Jan 26 12:07:32 HaPVEamax4 sshd[562338]: Disconnected from user root 172.xx.xxx.xx3 port 49886
Jan 26 12:07:32 HaPVEamax4 sshd[562338]: pam_unix(sshd:session): session closed for user root
Jan 26 12:07:32 HaPVEamax4 systemd[1]: session-108.scope: Succeeded.
Jan 26 12:07:32 HaPVEamax4 systemd-logind[1142]: Session 108 logged out. Waiting for processes to exit.
Jan 26 12:07:32 HaPVEamax4 systemd-logind[1142]: Removed session 108.
Jan 26 12:07:32 HaPVEamax4 pmxcfs[1516]: [status] notice: received log
Jan 26 12:07:39 HaPVEamax4 pve-ha-crm[1888]: service 'vm:125': state changed from 'migrate' to 'started' (node = HaPVEamax4)
Jan 26 12:07:39 HaPVEamax4 pve-ha-crm[1888]: migrate service 'vm:125' to node 'HaPVEamax3' (running)
Jan 26 12:07:39 HaPVEamax4 pve-ha-crm[1888]: service 'vm:125': state changed from 'started' to 'migrate' (node = HaPVEamax4, target = HaPVEamax3)
Jan 26 12:07:40 HaPVEamax4 pmxcfs[1516]: [status] notice: received log
Jan 26 12:07:42 HaPVEamax4 systemd[1]: Stopping User Manager for UID 0...
Jan 26 12:07:42 HaPVEamax4 systemd[562103]: Stopped target Default.
Jan 26 12:07:42 HaPVEamax4 systemd[562103]: Stopped target Basic System.
Jan 26 12:07:42 HaPVEamax4 systemd[562103]: Stopped target Paths.
Jan 26 12:07:42 HaPVEamax4 systemd[562103]: Stopped target Timers.
Jan 26 12:07:42 HaPVEamax4 systemd[562103]: Stopped target Sockets.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: dirmngr.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed GnuPG network certificate management daemon.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: gpg-agent-ssh.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed GnuPG cryptographic agent (ssh-agent emulation).
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: gpg-agent-browser.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed GnuPG cryptographic agent and passphrase cache (access for web browsers).
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: gpg-agent-extra.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed GnuPG cryptographic agent and passphrase cache (restricted).
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: gpg-agent.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed GnuPG cryptographic agent and passphrase cache.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: dbus.socket: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Closed D-Bus User Message Bus Socket.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Reached target Shutdown.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: systemd-exit.service: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Started Exit the Session.
Jan 26 12:07:43 HaPVEamax4 systemd[562103]: Reached target Exit the Session.
Jan 26 12:07:43 HaPVEamax4 systemd[562104]: pam_unix(systemd-user:session): session closed for user root
Jan 26 12:07:43 HaPVEamax4 systemd[1]: user@0.service: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[1]: Stopped User Manager for UID 0.
Jan 26 12:07:43 HaPVEamax4 systemd[1]: Stopping User Runtime Directory /run/user/0...
Jan 26 12:07:43 HaPVEamax4 systemd[1]: run-user-0.mount: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[1]: user-runtime-dir@0.service: Succeeded.
Jan 26 12:07:43 HaPVEamax4 systemd[1]: Stopped User Runtime Directory /run/user/0.
Jan 26 12:07:43 HaPVEamax4 systemd[1]: Removed slice User Slice of UID 0.
Jan 26 12:07:45 HaPVEamax4 pve-ha-lrm[562469]: <root@pam> starting task UPID:HaPVEamax4:0008952A:0048F53F:61F13991:qmigrate:125:root@pam:
Jan 26 12:07:47 HaPVEamax4 pmxcfs[1516]: [status] notice: received log
Jan 26 12:07:48 HaPVEamax4 pmxcfs[1516]: [status] notice: received log
Jan 26 12:07:50 HaPVEamax4 pve-ha-lrm[562469]: Task 'UPID:HaPVEamax4:0008952A:0048F53F:61F13991:qmigrate:125:root@pam:' still active, waiting
Jan 26 12:07:52 HaPVEamax4 kernel: vmbr0: port 18(tap125i0) entered disabled state
Jan 26 12:07:52 HaPVEamax4 qmeventd[1150]: read: Connection reset by peer
Jan 26 12:07:52 HaPVEamax4 systemd[1]: 125.scope: Succeeded.
Jan 26 12:07:54 HaPVEamax4 pve-ha-lrm[562469]: <root@pam> end task UPID:HaPVEamax4:0008952A:0048F53F:61F13991:qmigrate:125:root@pam: OK
Jan 26 12:07:59 HaPVEamax4 pve-ha-crm[1888]: service 'vm:125': state changed from 'migrate' to 'started' (node = HaPVEamax3)
Click to expand...
 
Thank you for the output.
Could you also provide the output of cat /etc/pve/ha/groups.cfg?
 
Ah!

I missed that setting for the longest time...
Obviously it was HA migrations which were the common factor.

Thanks for the pointer :)

Barry
 
  • Like
Reactions: mira
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom