CT migration fails

[stats]

Here is the logs(syslog) when I tried to migrate from pxmx03 to pxmx02.
If you need more informations please tell me what I should look for.
What does 'RRDC update error' mean? I think it seems no problem on my shared storage.

Satoshi

Logs on pxmx02
Jul 3 08:26:21 pxmx02 pmxcfs[2524]: [status] notice: received log
Jul 3 08:26:23 pxmx02 pct[63757]: <root@pam> starting task UPIDxmx02:0000F90E:07326870:5959811F:vzstart:100:root@pam:
Jul 3 08:26:23 pxmx02 pct[63758]: starting CT 100: UPIDxmx02:0000F90E:07326870:5959811F:vzstart:100:root@pam:
Jul 3 08:26:23 pxmx02 systemd[1]: Starting LXC Container: 100...
Jul 3 08:26:45 pxmx02 pvestatd[2614]: unable to get PID for CT 100 (not running?)
Jul 3 08:26:45 pxmx02 pvedaemon[23988]: unable to get PID for CT 100 (not running?)
Jul 3 08:26:45 pxmx02 pvestatd[2614]: status update time (15.184 seconds)
Jul 3 08:26:45 pxmx02 pmxcfs[2524]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/pxsvm01: -1
Jul 3 08:26:45 pxmx02 pmxcfs[2524]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/svm01: -1
Jul 3 08:26:45 pxmx02 pmxcfs[2524]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/pxsvm02: -1
Jul 3 08:26:50 pxmx02 lxc-start[63760]: lxc-start: tools/lxc_start.c: main: 366 The container failed to start.
Jul 3 08:26:50 pxmx02 lxc-start[63760]: lxc-start: tools/lxc_start.c: main: 368 To get more details, run the container in foreground mode.
Jul 3 08:26:50 pxmx02 lxc-start[63760]: lxc-start: tools/lxc_start.c: main: 370 Additional information can be obtained by setting the --logfile and --logpriority options.
Jul 3 08:26:50 pxmx02 systemd[1]: lxc@100.service: control process exited, code=exited status=1
Jul 3 08:26:50 pxmx02 systemd[1]: Failed to start LXC Container: 100.
Jul 3 08:26:50 pxmx02 systemd[1]: Unit lxc@100.service entered failed state.
Jul 3 08:26:50 pxmx02 pct[63758]: command 'systemctl start lxc@100' failed: exit code 1
Jul 3 08:26:50 pxmx02 pct[63757]: <root@pam> end task UPIDxmx02:0000F90E:07326870:5959811F:vzstart:100:root@pam: command 'systemctl start lxc@100' failed: exit code 1
Jul 3 08:26:50 pxmx02 pmxcfs[2524]: [status] notice: received log

Logs on pxmx03
Jul 3 08:26:21 pxmx03 pvedaemon[2639]: <satoshi@softagency.co.jp> starting task UPIDxmx03:000132BF:07351314:5959811D:vzmigrate:100:satoshi@softagency.co.jp:
Jul 3 08:26:21 pxmx03 kernel: [1209096.206289] vmbr0: port 4(veth100i0) entered disabled state
Jul 3 08:26:21 pxmx03 kernel: [1209096.206625] device veth100i0 left promiscuous mode
Jul 3 08:26:21 pxmx03 kernel: [1209096.206627] vmbr0: port 4(veth100i0) entered disabled state
Jul 3 08:26:22 pxmx03 pvedaemon[2641]: unable to get PID for CT 100 (not running?)
Jul 3 08:26:22 pxmx03 systemd[1]: lxc@100.service: main process exited, code=exited, status=1/FAILURE
Jul 3 08:26:22 pxmx03 systemd[1]: Unit lxc@100.service entered failed state.
Jul 3 08:26:23 pxmx03 pmxcfs[2541]: [status] notice: received log
Jul 3 08:26:45 pxmx03 pmxcfs[2541]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/pxsvm01: -1
Jul 3 08:26:45 pxmx03 pmxcfs[2541]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/svm01: -1
Jul 3 08:26:45 pxmx03 pmxcfs[2541]: [status] notice: RRDC update error /var/lib/rrdcached/db/pve2-storage/pxmx02/pxsvm02: -1
Jul 3 08:26:50 pxmx03 pmxcfs[2541]: [status] notice: received log
Jul 3 08:26:50 pxmx03 pvedaemon[78527]: migration problems
Jul 3 08:26:50 pxmx03 pvedaemon[2639]: <satoshi@softagency.co.jp> end task UPIDxmx03:000132BF:07351314:5959811D:vzmigrate:100:satoshi@softagency.co.jp: migration problems

 

[stats]

Hello,
It is a very serious problem for me. Please help me.

 

[wolfgang]

Hi,

this is no migration problem your container do not start.

Can you send the log after you run
lxc-start --name 100 -o ct100.log -l DEBUG

The log is ct100.log

after you run the fist command
run that command and send the output also

pct list

 

[stats]

I did it after the migration was failed. The log file is attached.

root@pxmx01:~# pct list
VMID Status Lock Name
100 stopped qktemp01
101 running qkwww
102 running qktproxy
104 running qkkibana
110 running sakibana
root@pxmx01:~# lxc-start --name 100 -o ct100.log -l DEBUG
root@pxmx01:~# pct list
VMID Status Lock Name
100 running qktemp01
101 running qkwww
102 running qktproxy
104 running qkkibana
110 running sakibana

 

[wolfgang]

Can you give us information about your NFS storage?

HW, Vendor, etc

 

[stats]

The storage is NetApp FAS2520A.