snapshots through api fail. manual snapshots working

[alexskysilk]

I have a weird problem with specific containers failing to snapshot; the end result is that scheduled vzdump tasks effectively fail and disallow any further vzdump jobs until manually killed.

The thing is, if I MANUALLY take a snapshot using rbd snap create it works fine- its only via api that it hangs, and only for specific, repeatable containers.

how to troubleshoot further?

pveversion -v

proxmox-ve: 5.1-32 (running kernel: 4.13.8-2-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.4-1-pve: 4.13.4-26
pve-kernel-4.13.8-2-pve: 4.13.8-28
pve-kernel-4.13.13-2-pve: 4.13.13-32
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9
openvswitch-switch: 2.7.0-2
ceph: 12.2.2-pve1

 

[wolfgang]

Hi,

how do you use the API?
And what you are doing a vzdump or just a snapshot?

 

[alexskysilk]

how do you use the API?

POST /api2/json/nodes/{node}/vzdump

Doing a snapshot either through vzdump or through snapshot hangs until manually cancelled. doing a snapshot using rbd snap create works... but its only to that one container. all others work normally.

 

[wolfgang]

We freeze the container before we make a snapshot, to keep data consistent.
Do you have a Fuse mount in your CT?
Because a fuse mount make freeze problems.

 

[alexskysilk]

yeah, I'm aware of the fuse mount issue, and we're not allowing it.

Oddly enough, since I updated to the current kernel version for the meltdown fix the problem appears to have gone...