Move Storage fails with qemu-img convert (Invalid argument)

[afif]

Hello,
I am having an issue when move storage from datastore-2 to datastore-1 in Proxmox. The process fails with a qemu-img error. I am still new to Proxmox and would like to ask what could be the cause of this issue.

root@pve-node-1:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content backup,iso,vztmpl,import

lvmthin: local-lvm-thin
        thinpool data
        vgname pve
        content rootdir,images
        nodes pve-node-1,pve-node-3,pve-node-2

iscsi: d1-mitigation-stor
        portal 10.221.61.228
        target iqn.2005-10.org.freenas.ctl:d1-share
        content images
        nodes pve-node-1,pve-node-2

iscsi: d2-ultimate-stor
        portal 10.221.61.226
        target iqn.2005-10.org.freenas.ctl:d2-share
        content images
        nodes pve-node-1,pve-node-2

lvm: Datastore-1
        vgname vg-d1-l1
        content rootdir,images
        nodes pve-node-1,pve-node-2
        saferemove 0
        shared 1

lvm: Datastore-2
        vgname vg-d2-l1
        content images,rootdir
        nodes pve-node-2,pve-node-1
        saferemove 0
        shared 1

root@pve-node-1:~# vgs
  VG       #PV #LV #SN Attr   VSize    VFree   
  pve        1   5   0 wz--n- <110.79g   13.75g
  vg-d1-l1   1   8   0 wz--n-  199.99g <103.59g
  vg-d2-l1   1   2   0 wz--n-  199.99g  139.99g
root@pve-node-1:~# lvs
  LV               VG       Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data             pve      twi-aotz-- <49.34g             0.01   1.59                           
  root             pve      -wi-ao---- <37.70g                                                   
  swap             pve      -wi-ao----   8.00g                                                   
  vm-100-disk-0    pve      Vwi-a-tz--  10.00g data        0.01                                   
  vm-102-cloudinit pve      Vwi---tz--   4.00m data                                               
  vm-101-cloudinit vg-d1-l1 -wi-ao----   4.00m                                                   
  vm-101-disk-0    vg-d1-l1 -wi-ao---- <12.20g                                                   
  vm-102-cloudinit vg-d1-l1 -wi-------   4.00m                                                   
  vm-102-disk-0    vg-d1-l1 -wi-a----- <22.20g                                                   
  vm-102-disk-1    vg-d1-l1 -wi-a-----  10.00g                                                   
  vm-102-disk-2    vg-d1-l1 -wi-a-----  10.00g                                                   
  vm-103-disk-0    vg-d1-l1 -wi-ao----  32.00g                                                   
  vm-103-disk-1    vg-d1-l1 -wi-ao----  10.00g                                                   
  vm-100-disk-0    vg-d2-l1 -wi-a-----  50.00g                                                   
  vm-100-disk-1    vg-d2-l1 -wi-a-----  10.00g

Error move storage

create full clone of drive scsi0 (Datastore-2:vm-100-disk-0)
  Wiping dos signature on /dev/vg-d1-l1/vm-100-disk-0.
  Logical volume "vm-100-disk-0" created.
transferred 0.0 B of 50.0 GiB (0.00%)
transferred 512.0 MiB of 50.0 GiB (1.00%)
transferred 1.0 GiB of 50.0 GiB (2.01%)
transferred 1.5 GiB of 50.0 GiB (3.01%)
transferred 2.0 GiB of 50.0 GiB (4.02%)
transferred 2.5 GiB of 50.0 GiB (5.02%)
qemu-img: error while writing at byte 2854223360: Invalid argument
  Logical volume "vm-100-disk-0" successfully removed.
TASK ERROR: storage migration failed: copy failed: command '/usr/bin/qemu-img convert -p -n -f raw -O raw /dev/vg-d2-l1/vm-100-disk-0 /dev/vg-d1-l1/vm-100-disk-0' failed: exit code 1

 

[afif]

Additional information:

The clone operation fails when the source VM is powered off.
However, when the source VM is running, the clone completes successfully.

I am not sure why cloning works only when the VM is online and fails when it is stopped.