I have a couple of ubuntu vm hung and unresponsive all of a sudden, and since there was no way of getting into the vm i tried to strace the vm process from pve and it was showing constant file descriptor polling similar to something like this
events=POLLIN|POLLRDNORM}, {fd=353, events=POLLIN|POLLRDNORM}, {fd=330, events=POLLIN|POLLRDNORM}, {fd=348, events=POLLIN|POLLRDNORM}, {fd=351, events=POLLIN|POLLRDNORM}, {fd=352, events=POLLIN|POLLRDNORM}, {fd=678, events=POLLIN|POLLRDNORM}, {fd=355, events=POLLIN|POLLRDNORM}, {fd=339, events=POLLIN|POLLRDNORM}, {fd=363, events=POLLIN|POLLRDNORM}, {fd=378, events=POLLIN|POLLRDNORM}, {fd=510, events=POLLIN|POLLRDNORM}, {fd=533,
since i couldn't do anything with the vm so i killed the process and started the vm to get it running again. once logged in, one thing that i notice is both server /var/log files have dates of "Dec 2176". Once the vm is up the time is correct and NTP is running.
Has anyone seen similar problem and could it be the cause of system being hung?
VM1
-rw-r----- 1 syslog adm 78K Nov 4 21:20 auth.log
-rw-rw-r-- 1 root utmp 711K Nov 4 21:20 wtmp
-rw-rw-r-- 1 root utmp 287K Nov 4 21:20 lastlog
-rw-r----- 1 syslog adm 62M Nov 4 21:21 syslog
-rw-r----- 1 syslog adm 12K Dec 12 2176 auth.log.1
-rw-r----- 1 syslog adm 402K Dec 12 2176 kern.log.1
-rw-r----- 1 syslog adm 4.5M Dec 12 2176 syslog.1
drwxr-x--- 2 root adm 4.0K Dec 12 2176 unattended-upgrades
-rw-r--r-- 1 root root 383 Dec 12 2176 ubuntu-advantage-timer.log
drwxr-xr-x 2 mongodb mongodb 4.0K Dec 12 2176 mongod
VM2
-rw-rw-r-- 1 root utmp 220K Nov 4 21:05 wtmp
-rw-rw-r-- 1 root utmp 286K Nov 4 21:05 lastlog
-rw-r----- 1 syslog adm 128K Nov 4 21:39 auth.log
-rw-r----- 1 syslog adm 6.1M Nov 4 21:39 syslog
-rw-rw---- 1 root utmp 0 Dec 11 2176 btmp.1
-rw-r--r-- 1 root root 29K Dec 11 2176 ubuntu-advantage-timer.log.1
-rw-r----- 1 syslog adm 146K Dec 11 2176 auth.log.1
-rw-r----- 1 syslog adm 890K Dec 11 2176 kern.log.1
-rw-r----- 1 syslog adm 2.3M Dec 11 2176 syslog.1
-rw-r--r-- 1 root root 0 Dec 11 2176 ubuntu-advantage-timer.log
pve-manager/7.2-11/b76d3178 (running kernel: 5.19.7-2-pve)
events=POLLIN|POLLRDNORM}, {fd=353, events=POLLIN|POLLRDNORM}, {fd=330, events=POLLIN|POLLRDNORM}, {fd=348, events=POLLIN|POLLRDNORM}, {fd=351, events=POLLIN|POLLRDNORM}, {fd=352, events=POLLIN|POLLRDNORM}, {fd=678, events=POLLIN|POLLRDNORM}, {fd=355, events=POLLIN|POLLRDNORM}, {fd=339, events=POLLIN|POLLRDNORM}, {fd=363, events=POLLIN|POLLRDNORM}, {fd=378, events=POLLIN|POLLRDNORM}, {fd=510, events=POLLIN|POLLRDNORM}, {fd=533,
since i couldn't do anything with the vm so i killed the process and started the vm to get it running again. once logged in, one thing that i notice is both server /var/log files have dates of "Dec 2176". Once the vm is up the time is correct and NTP is running.
Has anyone seen similar problem and could it be the cause of system being hung?
VM1
-rw-r----- 1 syslog adm 78K Nov 4 21:20 auth.log
-rw-rw-r-- 1 root utmp 711K Nov 4 21:20 wtmp
-rw-rw-r-- 1 root utmp 287K Nov 4 21:20 lastlog
-rw-r----- 1 syslog adm 62M Nov 4 21:21 syslog
-rw-r----- 1 syslog adm 12K Dec 12 2176 auth.log.1
-rw-r----- 1 syslog adm 402K Dec 12 2176 kern.log.1
-rw-r----- 1 syslog adm 4.5M Dec 12 2176 syslog.1
drwxr-x--- 2 root adm 4.0K Dec 12 2176 unattended-upgrades
-rw-r--r-- 1 root root 383 Dec 12 2176 ubuntu-advantage-timer.log
drwxr-xr-x 2 mongodb mongodb 4.0K Dec 12 2176 mongod
VM2
-rw-rw-r-- 1 root utmp 220K Nov 4 21:05 wtmp
-rw-rw-r-- 1 root utmp 286K Nov 4 21:05 lastlog
-rw-r----- 1 syslog adm 128K Nov 4 21:39 auth.log
-rw-r----- 1 syslog adm 6.1M Nov 4 21:39 syslog
-rw-rw---- 1 root utmp 0 Dec 11 2176 btmp.1
-rw-r--r-- 1 root root 29K Dec 11 2176 ubuntu-advantage-timer.log.1
-rw-r----- 1 syslog adm 146K Dec 11 2176 auth.log.1
-rw-r----- 1 syslog adm 890K Dec 11 2176 kern.log.1
-rw-r----- 1 syslog adm 2.3M Dec 11 2176 syslog.1
-rw-r--r-- 1 root root 0 Dec 11 2176 ubuntu-advantage-timer.log
pve-manager/7.2-11/b76d3178 (running kernel: 5.19.7-2-pve)