Hallo zusammen,
ich habe ein merkwürdiges Problem, vielleicht hat jemand eine Idee oder einen Ansatzpunkt den ich noch nicht ausprobiert habe.
Server:
HP ProLiant DL360 Gen9
2 x SSD im Raid 1 für Proxmox
2 x NVMe im ZFS1 für VM´s
6 x 2 TB SSD im Raid 50 als LVM-Thin für VM´s
pveversion
pve-manager/7.4-3/9002ab8a (running kernel: 5.15.107-1-pve)
Das System lief mehrere Monate, dann wurde es aus dem Cluster geworfen, Festplatten getauscht und der Arbeitsspeicher erhöht.
Anschließen Neuinstallation und danach sollten die VM´s wieder zurückgespielt werden. Das klappt aber nur wenn wir die VM´s auf das NVMe ZFS spielen.
Wenn eine Livemigration auf das SSD Raid (egal ob dieses als LVM oder LVM-Thin eingebunden ist) stattfindet, läuft die Migration "unendlich".
Dasselbe wenn ich die Disk einer VM die auf dem NVMe liegt auf SSD verschieben will, das Raid wurde komplett neu aufgebaut, formatiert und die Synchronisierung abgewartet. Hier ein Beispiel:
In den Logdateien konnte ich bisher nichts finden, es wirkt so als würde die Bestätigung über die erfolgte Migration ausbleiben.
Hatte das schonmal jemand und weiss da Rat ?
ich habe ein merkwürdiges Problem, vielleicht hat jemand eine Idee oder einen Ansatzpunkt den ich noch nicht ausprobiert habe.
Server:
HP ProLiant DL360 Gen9
2 x SSD im Raid 1 für Proxmox
2 x NVMe im ZFS1 für VM´s
6 x 2 TB SSD im Raid 50 als LVM-Thin für VM´s
pveversion
pve-manager/7.4-3/9002ab8a (running kernel: 5.15.107-1-pve)
Das System lief mehrere Monate, dann wurde es aus dem Cluster geworfen, Festplatten getauscht und der Arbeitsspeicher erhöht.
Anschließen Neuinstallation und danach sollten die VM´s wieder zurückgespielt werden. Das klappt aber nur wenn wir die VM´s auf das NVMe ZFS spielen.
Wenn eine Livemigration auf das SSD Raid (egal ob dieses als LVM oder LVM-Thin eingebunden ist) stattfindet, läuft die Migration "unendlich".
Dasselbe wenn ich die Disk einer VM die auf dem NVMe liegt auf SSD verschieben will, das Raid wurde komplett neu aufgebaut, formatiert und die Synchronisierung abgewartet. Hier ein Beispiel:
create full clone of drive virtio0 (nvme-zfs:vm-227-disk-0)
Logical volume "vm-227-disk-0" created.
drive mirror is starting for drive-virtio0 with bandwidth limit: 2048000 KB/s
drive-virtio0: transferred 0.0 B of 60.0 GiB (0.00%) in 0s
drive-virtio0: transferred 744.0 MiB of 60.0 GiB (1.21%) in 1s
drive-virtio0: transferred 1.5 GiB of 60.0 GiB (2.50%) in 2s
drive-virtio0: transferred 2.4 GiB of 60.0 GiB (3.97%) in 3s
drive-virtio0: transferred 3.2 GiB of 60.0 GiB (5.37%) in 4s
drive-virtio0: transferred 4.2 GiB of 60.0 GiB (7.00%) in 5s
...
drive-virtio0: transferred 53.4 GiB of 60.0 GiB (88.94%) in 1m 21s
drive-virtio0: transferred 54.8 GiB of 60.0 GiB (91.33%) in 1m 22s
drive-virtio0: transferred 56.3 GiB of 60.0 GiB (93.85%) in 1m 23s
drive-virtio0: transferred 57.9 GiB of 60.0 GiB (96.42%) in 1m 24s
drive-virtio0: transferred 59.2 GiB of 60.0 GiB (98.68%) in 1m 25s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 26s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 27s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 28s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 29s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 30s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 31s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 32s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 33s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 34s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 35s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 36s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 37s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 38s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 39s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 40s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 41s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 42s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 43s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 44s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 45s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 46s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 47s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 48s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 49s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 50s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 51s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 52s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 53s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 54s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 55s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 56s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 57s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 58s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 1m 59s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 1s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 2s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 3s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 4s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 5s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 6s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 7s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 8s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 9s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 10s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 11s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 12s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 13s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 14s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 15s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 16s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 17s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 18s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 19s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 20s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 21s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 22s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 23s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 24s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 25s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 26s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 27s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 28s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 29s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 30s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 31s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 32s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 33s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 34s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 35s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 36s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 37s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 38s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 39s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 40s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 41s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 42s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 43s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 44s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 45s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 46s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 47s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 48s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 49s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 50s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 51s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 52s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 53s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 54s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 55s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 56s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 57s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 58s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 2m 59s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 1s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 2s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 3s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 4s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 5s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 6s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 7s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 8s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 9s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 10s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 11s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 12s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 13s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 14s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 15s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 16s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 17s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 18s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 19s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 20s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 21s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 22s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 23s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 24s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 25s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 26s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 27s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 28s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 29s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 30s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 31s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 32s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 33s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 34s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 35s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 36s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 37s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 38s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 39s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 40s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 41s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 42s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 43s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 44s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 45s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 46s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 47s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 48s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 49s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 50s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 51s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 52s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 53s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 54s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 55s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 56s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 57s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 58s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 3m 59s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 4m
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 4m 1s
drive-virtio0: transferred 60.0 GiB of 60.0 GiB (100.00%) in 4m 2s
drive-virtio0: Cancelling block job
In den Logdateien konnte ich bisher nichts finden, es wirkt so als würde die Bestätigung über die erfolgte Migration ausbleiben.
Hatte das schonmal jemand und weiss da Rat ?