My VMs and proxmox all get stuck and become not functional every few days after reset.
Interstingly, they all respond to pings but I can't access them through UI or SSH.
Please guide me what kind of logs should I look for. I am completely newbe with proxmox.
The installation is on a N100 mini PC (Beeling S12).
Proxmox is updated to latest version.
For reference, I put the logs between the moment it got stuck and the reboot I did to bring it back to life.
Aug 26 21:52:09 pve pvedaemon[955]: <root@pam> end task UPIDve:00003E26:0005AF78:66CCDB81:vzdump::root@pam: OK
Aug 26 21:52:09 pve postfix/cleanup[17669]: 2CE5AC036F: message-id=<20240826195209.2CE5AC036F@pve.local>
Aug 26 21:52:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:52:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.18]:25: Connection timed out
Aug 26 21:53:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 21:53:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.194.2]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=120, delays=0.01/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out)
Aug 26 21:59:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:59:39 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.16]:25: Connection timed out
Aug 26 22:00:09 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.41.23]:25: Connection timed out
Aug 26 22:00:37 pve pvedaemon[956]: <root@pam> successful auth for user 'root@pam'
Aug 26 22:00:40 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.53]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=541, delays=420/0.01/121/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out)
Aug 26 22:14:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 22:14:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.11]:25: Connection timed out
Aug 26 22:15:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.9.13]:25: Connection timed out
Aug 26 22:15:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.3]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=1441, delays=1320/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Aug 26 22:17:01 pve CRON[23222]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session closed for user root
Aug 26 22:22:26 pve kernel: perf: interrupt took too long (3158 > 3131), lowering kernel.perf_event_max_sample_rate to 63000
-- Reboot --
Aug 27 07:38:09 pve kernel: Linux version 6.8.12-1-pve (build@proxmox) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-1 (2024-08-05T16:17Z) ()
Aug 27 07:38:09 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.8.12-1-pve root=/dev/mapper/pve-root ro quiet
Aug 27 07:38:09 pve kernel: KERNEL supported cpus:
Interstingly, they all respond to pings but I can't access them through UI or SSH.
Please guide me what kind of logs should I look for. I am completely newbe with proxmox.
The installation is on a N100 mini PC (Beeling S12).
Proxmox is updated to latest version.
For reference, I put the logs between the moment it got stuck and the reboot I did to bring it back to life.
Code:
Aug 26 21:52:09 pve pvedaemon[955]: <root@pam> end task UPID:pve:00003E26:0005AF78:66CCDB81:vzdump::root@pam: OK
Aug 26 21:52:09 pve postfix/cleanup[17669]: 2CE5AC036F: message-id=<20240826195209.2CE5AC036F@pve.local>
Aug 26 21:52:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:52:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.18]:25: Connection timed out
Aug 26 21:53:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 21:53:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.194.2]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: 2CE5AC036F: to=<@@@@@hotmail.com>, relay=none, delay=120, delays=0.01/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out)
Aug 26 21:59:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:59:39 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.16]:25: Connection timed out
Aug 26 22:00:09 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.41.23]:25: Connection timed out
Aug 26 22:00:37 pve pvedaemon[956]: <root@pam> successful auth for user 'root@pam'
Aug 26 22:00:40 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.53]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=541, delays=420/0.01/121/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out)
Aug 26 22:14:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 22:14:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.11]:25: Connection timed out
Aug 26 22:15:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.9.13]:25: Connection timed out
Aug 26 22:15:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.3]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=1441, delays=1320/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Aug 26 22:17:01 pve CRON[23222]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session closed for user root
Aug 26 22:22:26 pve kernel: perf: interrupt took too long (3158 > 3131), lowering kernel.perf_event_max_sample_rate to 63000
-- Reboot --
Aug 27 07:38:09 pve kernel: Linux version 6.8.12-1-pve (build@proxmox) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-1 (2024-08-05T16:17Z) ()
Aug 27 07:38:09 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.8.12-1-pve root=/dev/mapper/pve-root ro quiet
Aug 27 07:38:09 pve kernel: KERNEL supported cpus:
Aug 26 21:52:09 pve postfix/cleanup[17669]: 2CE5AC036F: message-id=<20240826195209.2CE5AC036F@pve.local>
Aug 26 21:52:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:52:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.18]:25: Connection timed out
Aug 26 21:53:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 21:53:39 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.194.2]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out
Aug 26 21:54:09 pve postfix/smtp[17671]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=120, delays=0.01/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.42.7]:25: Connection timed out)
Aug 26 21:59:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 21:59:39 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.16]:25: Connection timed out
Aug 26 22:00:09 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.41.23]:25: Connection timed out
Aug 26 22:00:37 pve pvedaemon[956]: <root@pam> successful auth for user 'root@pam'
Aug 26 22:00:40 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.53]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out
Aug 26 22:01:10 pve postfix/smtp[19229]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=541, delays=420/0.01/121/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.8.35]:25: Connection timed out)
Aug 26 22:14:09 pve postfix/qmgr[910]: 2CE5AC036F: from=<root@pve.local>, size=32428, nrcpt=1 (queue active)
Aug 26 22:14:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.11.11]:25: Connection timed out
Aug 26 22:15:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.9.13]:25: Connection timed out
Aug 26 22:15:39 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.73.3]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out
Aug 26 22:16:09 pve postfix/smtp[22568]: 2CE5AC036F: to=<@@@@hotmail.com>, relay=none, delay=1441, delays=1320/0.01/120/0, dsn=4.4.1, status=deferred (connect to hotmail-com.olc.protection.outlook.com[52.101.40.5]:25: Connection timed out)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Aug 26 22:17:01 pve CRON[23222]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Aug 26 22:17:01 pve CRON[23221]: pam_unix(cron:session): session closed for user root
Aug 26 22:22:26 pve kernel: perf: interrupt took too long (3158 > 3131), lowering kernel.perf_event_max_sample_rate to 63000
-- Reboot --
Aug 27 07:38:09 pve kernel: Linux version 6.8.12-1-pve (build@proxmox) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-1 (2024-08-05T16:17Z) ()
Aug 27 07:38:09 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.8.12-1-pve root=/dev/mapper/pve-root ro quiet
Aug 27 07:38:09 pve kernel: KERNEL supported cpus:
Last edited: