Node is fine but CTs showing grey questionmark

[encore]

Hi guys,

we are facing an issue with one node for some days now.
The node itself is listed green in proxmox, all services running:
http://prntscr.com/jvni6z

All CTs are running and accessable fine via SSH, also summary in proxmox of these CTs work fine. No issues so far. Also the proxmox API give status "ONLINE" back.
But: All CTs show a grey questionmark:
http://prntscr.com/jvnie8

Any ideas to debug it further?
It only affects CTs on one node. All other nodes CTs are showing a green icon.

 

[dcsapak]

you could try to to restart the pvestatd on that node

 

[encore]

you could try to to restart the pvestatd on that node

already did. Figured out the pvestatd seems to have 50% cpu load permanent. How can I debug where it maybe stucks?

 

[encore]

systemctl status pvestatd shows this:

Jul 05 12:35:08 captive001-72001-bl03 pvestatd[9496]: lxc status update error: can't open '/sys/fs/cgroup/cpuacct/lxc/9957/ns/cpuacct.stat' - No such file or directory
Jul 05 12:35:28 captive001-72001-bl03 pvestatd[9496]: lxc console cleanup error: can't open '/sys/fs/cgroup/cpuacct/lxc/9769/ns/cpuacct.stat' - No such file or directory
Jul 05 12:35:28 captive001-72001-bl03 pvestatd[9496]: status update time (39.038 seconds)
Jul 05 12:35:49 captive001-72001-bl03 pvestatd[9496]: lxc status update error: can't open '/sys/fs/cgroup/cpuacct/lxc/9780/ns/cpuacct.stat' - No such file or directory
Jul 05 12:36:08 captive001-72001-bl03 pvestatd[9496]: lxc console cleanup error: can't open '/sys/fs/cgroup/cpuacct/lxc/9780/ns/cpuacct.stat' - No such file or directory
Jul 05 12:36:08 captive001-72001-bl03 pvestatd[9496]: status update time (39.620 seconds)
Jul 05 12:36:25 captive001-72001-bl03 pvestatd[9496]: lxc status update error: can't open '/sys/fs/cgroup/cpuacct/lxc/10054/ns/cpuacct.stat' - No such file or directory
Jul 05 12:36:49 captive001-72001-bl03 pvestatd[9496]: lxc console cleanup error: can't open '/sys/fs/cgroup/cpuacct/lxc/9769/ns/cpuacct.stat' - No such file or directory
Jul 05 12:36:49 captive001-72001-bl03 pvestatd[9496]: status update time (41.822 seconds)
Jul 05 12:37:08 captive001-72001-bl03 pvestatd[9496]: lxc status update error: can't open '/sys/fs/cgroup/cpuacct/lxc/9780/ns/cpuacct.stat' - No such file or directory

When I restart these mentioned CTs it is fixed for a while but happens again after some minutes/hours.