[SOLVED] Why does my PVE-Cluster migrate VMs and CTs when issueing the start command?

[Noah0302]

This has started happening ever since PVE 7.4.x

I can reproduce the issue 100% of the time when (bulk) stopping VMs and CTs on one Node, then (bulk) starting them back up again.
As soon as the start command is issued, the VMs and CTs will migrate to a different Node, although they should just start back up again on the same Node.
Is there a setting that changed the way HA is handled by the Cluster?

Here are my Currently installed Packages and Settings:

proxmox-ve: 7.4-1 (running kernel: 5.15.107-2-pve)
pve-manager: 7.4-3 (running version: 7.4-3/9002ab8a)
pve-kernel-5.15: 7.4-3
pve-kernel-5.15.107-2-pve: 5.15.107-2
pve-kernel-5.15.107-1-pve: 5.15.107-1
pve-kernel-5.15.104-1-pve: 5.15.104-2
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph: 17.2.5-pve1
ceph-fuse: 17.2.5-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.4
libproxmox-backup-qemu0: 1.3.1-1
libproxmox-rs-perl: 0.2.1
libpve-access-control: 7.4-2
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.4-1
libpve-guest-common-perl: 4.2-4
libpve-http-server-perl: 4.2-3
libpve-rs-perl: 0.7.6
libpve-storage-perl: 7.4-2
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.2-2
lxcfs: 5.0.3-pve1
novnc-pve: 1.4.0-1
proxmox-backup-client: 2.4.1-1
proxmox-backup-file-restore: 2.4.1-1
proxmox-kernel-helper: 7.4-1
proxmox-mail-forward: 0.1.1-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.1-1
proxmox-widget-toolkit: 3.6.5
pve-cluster: 7.3-3
pve-container: 4.4-3
pve-docs: 7.4-2
pve-edk2-firmware: 3.20230228-2
pve-firewall: 4.3-1
pve-firmware: 3.6-5
pve-ha-manager: 3.6.1
pve-i18n: 2.12-1
pve-qemu-kvm: 7.2.0-8
pve-xtermjs: 4.16.0-1
qemu-server: 7.4-3
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+3
vncterm: 1.7-1
zfsutils-linux: 2.1.11-pve1

Thank you for reading!

 

[CalebSnell]

Could it be triggering because max restart in your second screenshot is 1 and starting it up counts as a restart somehow? could you try adjusting max restart to 2 for one of the CTs and see if the behavior is any different?

 

[Noah0302]

Could it be triggering because max restart in your second screenshot is 1 and starting it up counts as a restart somehow? could you try adjusting max restart to 2 for one of the CTs and see if the behavior is any different?

Thank you for the reply, I'll test it but thats how I set it for the last months and I never had this issue before 7.4.

 

[Noah0302]

UPDATE:

I found the Issue! I previously experimented with the "Rebalance on Start" setting.
It seems like enable- and disabling the setting fixed it for me, maybe it did not get properly disabled? idk...