Unable to clone LXC containers or templates, just spins

[coNemniatEND]

clone LXC template - does not error out, task keeps on running over 12mins does not stop, I have to manually stop it
clone LXC container - same thing

I created a new container from default ubuntu-20.04 template and still unable to clone.
I can create new containers no issues.

When I manually stop it, it gives me this error message.

malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/share/perl5/PVE/Tools.pm line 1003, <GEN6784> chunk 1.
Logical volume "vm-109-disk-0" successfully removed
TASK ERROR: clone failed: interrupted by unexpected signal


Version is 6.3.3
proxmox-ve: 6.3-1 (running kernel: 5.4.78-2-pve)
pve-manager: 6.3-3 (running version: 6.3-3/eee5f901)
pve-kernel-5.4: 6.3-3
pve-kernel-helper: 6.3-3

 

[Moayad]

Hi,

Please post full output of pveversion -v and config for the LXC Container pct config <VMID>.

have you tried with CLI like command below?

pct clone 100 9999 --storage local

 

[coNemniatEND]

Hi,

I just tried cli "pct clone 200 109 --storage local-ssd-01" and it still hangs
I also left a clone over night and the task ran for 11 hours until I manually stopped it.

pct clone 200 109 --storage local-ssd-01
create full clone of mountpoint rootfs (local-ssd-01:vm-200-disk-0)
mke2fs 1.44.5 (15-Dec-2018)
Discarding device blocks: done
Creating filesystem with 2097152 4k blocks and 524288 inodes
Filesystem UUID: 43219875-95c1-48fa-878d-a7dc1c9dd59e
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables: done
Writing inode tables: done
Creating journal (16384 blocks): done
Multiple mount protection is enabled with update interval 5 seconds.
Writing superblocks and filesystem accounting information: done


Number of files: 22,085 (reg: 16,906, dir: 2,129, link: 3,019, special: 31)
Number of created files: 22,083 (reg: 16,906, dir: 2,127, link: 3,019, special: 31)
Number of deleted files: 0
Number of regular files transferred: 16,887
Total file size: 1,087,660,412 bytes
Total transferred file size: 845,045,622 bytes
Literal data: 845,045,622 bytes
Matched data: 0 bytes
File list size: 720,849
File list generation time: 0.009 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 846,585,223
Total bytes received: 342,805

sent 846,585,223 bytes  received 342,805 bytes  48,395,887.31 bytes/sec
total size is 1,087,660,412  speedup is 1.28
"No more output after this"

pct config 200
arch: amd64
cores: 2
hostname: ubuntu-20.04-template
lock: disk
memory: 2048
net0: name=eth0,bridge=vmbr25,firewall=1,gw=192.168.99.1,hwaddr=3E:0F:61:4E:07:66,ip=192.168.99.111/24,type=veth
ostype: ubuntu
rootfs: local-ssd-01:vm-200-disk-0,size=8G
swap: 0
unprivileged: 1

pveversion -v
proxmox-ve: 6.3-1 (running kernel: 5.4.78-2-pve)
pve-manager: 6.3-3 (running version: 6.3-3/eee5f901)
pve-kernel-5.4: 6.3-3
pve-kernel-helper: 6.3-3
pve-kernel-5.3: 6.1-6
pve-kernel-5.0: 6.0-11
pve-kernel-5.4.78-2-pve: 5.4.78-2
pve-kernel-5.4.34-1-pve: 5.4.34-2
pve-kernel-5.3.18-3-pve: 5.3.18-3
pve-kernel-5.0.21-5-pve: 5.0.21-10
pve-kernel-5.0.15-1-pve: 5.0.15-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.0.4-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown2: 3.0.0-1+pve3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.16-pve1
libproxmox-acme-perl: 1.0.7
libproxmox-backup-qemu0: 1.0.2-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-2
libpve-guest-common-perl: 3.1-3
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-3
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.3-1
lxcfs: 4.0.3-pve3
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.6-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-3
pve-cluster: 6.2-1
pve-container: 3.3-2
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.1-3
pve-ha-manager: 3.1-1
pve-i18n: 2.2-2
pve-qemu-kvm: 5.1.0-7
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-2
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-2

This is what happens when I stop it.

total size is 1,087,660,412  speedup is 1.28
malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/share/perl5/PVE/Tools.pm line 1003, <GEN62> chunk 1.
  Logical volume "vm-109-disk-0" successfully removed
clone failed: interrupted by unexpected signal

Thank you

 

[Moayad]

Thanks for the outputs, can you try to clone a normal VM and see if that happens?

 

[coNemniatEND]

Thank you for the help, I figured it out.

It has to do with bad NFS mounts, I am not sure why that would affect it.
When I did "df " it would hang. I removed non used mounts and rebooted. I am able to clone successfully now.

 

[Moayad]

Thanks for sharing your solution

If that happened again please check your syslog or dmesg if there any error on NFS storage.