Problem migrating a single VM

[tplecko]

I have a two node cluster (no HA or CEPH)
I have a mix of VMs (Windows and Linux), and LXCs, and I can migrate all of the VMs, except for one.

The one VM (windows) migration errors out with "ERROR: missing replicate feature on volume 'local-ssd-dir:102/vm-102-disk-0.raw'"

The disk in question is TPM state disk.

Two additional VMs (with the same exact configuration) migrate just fine.

Both clusters have the same exact volumes: [lvm] local-nvme (which I'm trying to empty, so I can configure CEPH), and [directory] local-ssd-dir

I'm not sure where to check for a more detailed error message? Or what could possibly be wrong.

All of the machines were restored from backup at some point in the past.

Thanks

 

[bbgeek17]

Two additional VMs (with the same exact configuration) migrate just fine.

Post one configuration from "good" vm and from "bad" vm. (qm config [vmid].

Both clusters have the same exact volumes: [lvm] local-nvme (which I'm trying to empty, so I can configure CEPH), and [directory] local-ssd-dir

They cant be both clusters, do you mean both members of the cluster? Post the context of your "/etc/pve/storage.cfg". Is your root ([directory]) on ZFS?
https://forum.proxmox.com/threads/m...on-volume-local-lvm-vm-1001-disk-1-500.35709/
https://forum.proxmox.com/threads/no-replicable-volumes-found.117292/
https://forum.proxmox.com/threads/replication-problem.79107/

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[tplecko]

I ment "both nodes"
There is no ZFs, since I don't have the memory for it.

VM that doesn't replicate:

root@pve-01:~# qm config 102
agent: 1,fstrim_cloned_disks=1
balloon: 4096
bios: ovmf
boot: order=sata0;ide2;net0
cores: 8
efidisk0: local-ssd-dir:102/vm-102-disk-0.raw,efitype=4m,pre-enrolled-keys=1,size=528K
ide2: none,media=cdrom
machine: pc-q35-7.0
memory: 12288
meta: creation-qemu=7.0.0,ctime=1668374897
name: plecko
net0: e1000=DE:DB:F8:AB:8E:5C,bridge=vmbr0,firewall=1,tag=100
numa: 0
onboot: 1
ostype: win11
sata0: local-ssd-dir:102/vm-102-disk-1.raw,size=80G
scsihw: virtio-scsi-pci
smbios1: uuid=2b476caa-bd98-49bd-a51b-ce883fa7bbf2
sockets: 1
tags: plecko
tpmstate0: local-ssd-dir:102/vm-102-disk-2.raw,size=4M,version=v2.0
vmgenid: 6b595d98-4658-410b-9dff-8d311ad51ad2
root@pve-01:~#

VM that replicates just fine:

root@pve-02:~# qm config 101
agent: 1,fstrim_cloned_disks=1
balloon: 2048
bios: ovmf
boot: order=sata0;ide2;net0
cores: 4
efidisk0: local-ssd-dir:101/vm-101-disk-0.raw,efitype=4m,format=raw,pre-enrolled-keys=1,size=528K
ide2: none,media=cdrom
machine: pc-q35-6.2
memory: 3072
meta: creation-qemu=6.2.0,ctime=1667681385
name: adds
net0: e1000=5A:B3:8C:F8:E9:79,bridge=vmbr0,firewall=1
numa: 0
onboot: 1
ostype: win11
sata0: local-ssd-dir:101/vm-101-disk-1.raw,format=raw,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=7d1d3fe0-d68d-4426-8a6b-20eac65f9668
sockets: 1
tags: home
tpmstate0: local-ssd-dir:101/vm-101-disk-2.raw,size=4M,version=v2.0
vmgenid: 9d5c9beb-f7d7-44cb-88c8-a74e9b9507b7
root@pve-02:~#

/etc/pve/storage.cfg on pve-01

dir: local
        path /var/lib/vz
        content vztmpl,iso,backup

lvmthin: local-lvm
        thinpool data
        vgname pve
        content rootdir,images

lvm: local-nvme
        vgname local-nvme
        content rootdir,images
        nodes pve-02,pve-01
        shared 0

dir: local-ssd-dir
        path /mnt/pve/local-ssd-dir
        content iso,backup,rootdir,images,snippets,vztmpl
        is_mountpoint 1
        nodes pve-02,pve-01

/etc/pve/storage.cfg on pve-02

dir: local
        path /var/lib/vz
        content vztmpl,iso,backup

lvmthin: local-lvm
        thinpool data
        vgname pve
        content rootdir,images

lvm: local-nvme
        vgname local-nvme
        content rootdir,images
        nodes pve-02,pve-01
        shared 0

dir: local-ssd-dir
        path /mnt/pve/local-ssd-dir
        content iso,backup,rootdir,images,snippets,vztmpl
        is_mountpoint 1
        nodes pve-02,pve-01