Abnormal CPU usage on Saturday around 8:00

W

walber

New Member
Oct 23, 2023
5
1
3
I'm having a problem with a VM running Home Assistant.

Almost every Saturday around 8:00, the CPU usage is going up, two/three times the normal usage.

1743262614030.png

1743262647184.png

Using TOP in HA, I don't see anything unusual.

Code: 
      1 root      20   0     436      0      0 S   0.0   0.0   0:00.01 s6-svscan
     17 root      20   0     220      0      0 S   0.0   0.0   0:00.00 s6-supervise
     20 root      20   0     208      0      0 S   0.0   0.0   0:00.00 s6-linux-init-s
     26 root      20   0     220      0      0 S   0.0   0.0   0:00.00 s6-supervise
     27 root      20   0     220      0      0 S   0.0   0.0   0:00.00 s6-supervise
     28 root      20   0     220      0      0 S   0.0   0.0   0:00.00 s6-supervise
     29 root      20   0     220      0      0 S   0.0   0.0   0:00.00 s6-supervise
     37 root      20   0     208      0      0 S   0.0   0.0   0:00.00 s6-ipcserverd
    314 root      20   0    6116   3476   3220 S   0.0   0.1   0:00.03 sshd
    315 root      20   0    7376   1632   1632 S   0.0   0.0   0:03.93 ttyd
    731 root      20   0    6608   4376   3608 S   0.0   0.1   0:00.00 sshd-session
    733 junior    20   0    6892   3668   2624 S   0.0   0.1   0:00.02 sshd-session
    734 root      20   0    1924   1388   1260 S   0.0   0.0   0:00.01 sudo
    736 root      20   0    1920    740    612 S   0.0   0.0   0:00.00 sudo
    737 root      20   0    4152   3872   1860 S   0.0   0.1   0:00.33 zsh
    833 root      20   0    3712   2964   1044 R   0.0   0.0   0:00.01 top


Using TOP in proxmox KVM is using a lot of CPU:

Code: 
3005541 root      20   0    9.9g   5.9g   6784 S 144.5  19.7     77,24 kvm

journalctl --since "2025-03-29 07:00:00" --until "2025-03-29 12:00:00" > /root/journalctl.log

Code: 
Mar 29 07:00:49 pve pveproxy[1064]: worker 2946956 finished
Mar 29 07:00:49 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 07:00:49 pve pveproxy[1064]: worker 3063599 started
Mar 29 07:00:50 pve pveproxy[3063597]: worker exit
Mar 29 07:06:45 pve pveproxy[2962686]: worker exit
Mar 29 07:06:45 pve pveproxy[1064]: worker 2962686 finished
Mar 29 07:06:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 07:06:45 pve pveproxy[1064]: worker 3071418 started
Mar 29 07:06:46 pve pvedaemon[2895866]: <root@pam> successful auth for user 'ha@pve'
Mar 29 07:16:45 pve pveproxy[2968689]: worker exit
Mar 29 07:16:45 pve pveproxy[1064]: worker 2968689 finished
Mar 29 07:16:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 07:16:45 pve pveproxy[1064]: worker 3085114 started
Mar 29 07:17:01 pve CRON[3085557]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 29 07:17:01 pve CRON[3085558]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 29 07:17:01 pve CRON[3085557]: pam_unix(cron:session): session closed for user root
Mar 29 07:32:46 pve pvedaemon[2866734]: worker exit
Mar 29 07:32:46 pve pvedaemon[1055]: worker 2866734 finished
Mar 29 07:32:46 pve pvedaemon[1055]: starting 1 worker(s)
Mar 29 07:32:46 pve pvedaemon[1055]: worker 3107649 started
Mar 29 07:53:09 pve pvestatd[1033]: auth key pair too old, rotating..
Mar 29 07:59:46 pve systemd[1]: Starting apt-daily.service - Daily apt download activities...
Mar 29 07:59:47 pve systemd[1]: apt-daily.service: Deactivated successfully.
Mar 29 07:59:47 pve systemd[1]: Finished apt-daily.service - Daily apt download activities.
Mar 29 08:03:45 pve pvedaemon[2895866]: worker exit
Mar 29 08:03:45 pve pvedaemon[1055]: worker 2895866 finished
Mar 29 08:03:45 pve pvedaemon[1055]: starting 1 worker(s)
Mar 29 08:03:45 pve pvedaemon[1055]: worker 3149345 started
Mar 29 08:06:48 pve pvedaemon[3052288]: <root@pam> successful auth for user 'ha@pve'
Mar 29 08:17:01 pve CRON[3167735]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 29 08:17:01 pve CRON[3167736]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 29 08:17:01 pve CRON[3167735]: pam_unix(cron:session): session closed for user root
Mar 29 08:30:45 pve pveproxy[3063599]: worker exit
Mar 29 08:30:45 pve pveproxy[1064]: worker 3063599 finished
Mar 29 08:30:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 08:30:45 pve pveproxy[1064]: worker 3185440 started
Mar 29 08:33:45 pve pveproxy[1064]: worker 3071418 finished
Mar 29 08:33:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 08:33:45 pve pveproxy[1064]: worker 3189127 started
Mar 29 08:33:45 pve pveproxy[3189121]: got inotify poll request in wrong process - disabling inotify
Mar 29 08:33:46 pve pveproxy[3189121]: worker exit
Mar 29 08:38:45 pve pveproxy[1064]: worker 3085114 finished
Mar 29 08:38:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 08:38:45 pve pveproxy[1064]: worker 3195338 started
Mar 29 08:38:45 pve pveproxy[3195337]: got inotify poll request in wrong process - disabling inotify
Mar 29 08:38:50 pve pveproxy[3195337]: worker exit
Mar 29 09:06:48 pve pvedaemon[3149345]: <root@pam> successful auth for user 'ha@pve'
Mar 29 09:17:01 pve CRON[3249705]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 29 09:17:01 pve CRON[3249706]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 29 09:17:01 pve CRON[3249705]: pam_unix(cron:session): session closed for user root
Mar 29 09:53:45 pve pveproxy[1064]: worker 3185440 finished
Mar 29 09:53:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 09:53:45 pve pveproxy[1064]: worker 3297376 started
Mar 29 09:53:45 pve pveproxy[3297371]: got inotify poll request in wrong process - disabling inotify
Mar 29 09:53:48 pve pvedaemon[3052288]: worker exit
Mar 29 09:53:48 pve pvedaemon[1055]: worker 3052288 finished
Mar 29 09:53:48 pve pvedaemon[1055]: starting 1 worker(s)
Mar 29 09:53:48 pve pvedaemon[1055]: worker 3297471 started
Mar 29 09:53:50 pve pveproxy[3297371]: worker exit
Mar 29 09:54:49 pve pveproxy[3189127]: worker exit
Mar 29 09:54:49 pve pveproxy[1064]: worker 3189127 finished
Mar 29 09:54:49 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 09:54:49 pve pveproxy[1064]: worker 3298945 started
Mar 29 10:06:48 pve pvedaemon[3107649]: <root@pam> successful auth for user 'ha@pve'
Mar 29 10:10:45 pve pveproxy[1064]: worker 3195338 finished
Mar 29 10:10:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 10:10:45 pve pveproxy[1064]: worker 3319078 started
Mar 29 10:10:50 pve pveproxy[3319075]: got inotify poll request in wrong process - disabling inotify
Mar 29 10:10:50 pve pveproxy[3319075]: worker exit
Mar 29 10:17:01 pve CRON[3326891]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 29 10:17:01 pve CRON[3326892]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 29 10:17:01 pve CRON[3326891]: pam_unix(cron:session): session closed for user root
Mar 29 10:37:48 pve pvedaemon[3107649]: worker exit
Mar 29 10:37:48 pve pvedaemon[1055]: worker 3107649 finished
Mar 29 10:37:48 pve pvedaemon[1055]: starting 1 worker(s)
Mar 29 10:37:48 pve pvedaemon[1055]: worker 3355677 started
Mar 29 10:58:47 pve systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Mar 29 10:58:47 pve systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
Mar 29 10:58:47 pve systemd[1]: Finished systemd-tmpfiles-clean.service - Cleanup of Temporary Directories.
Mar 29 10:58:47 pve systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully.
Mar 29 11:06:49 pve pvedaemon[3355677]: <root@pam> successful auth for user 'ha@pve'
Mar 29 11:14:46 pve pvedaemon[3149345]: worker exit
Mar 29 11:14:46 pve pvedaemon[1055]: worker 3149345 finished
Mar 29 11:14:46 pve pvedaemon[1055]: starting 1 worker(s)
Mar 29 11:14:46 pve pvedaemon[1055]: worker 3408213 started
Mar 29 11:15:49 pve pveproxy[1064]: worker 3297376 finished
Mar 29 11:15:49 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 11:15:49 pve pveproxy[1064]: worker 3409694 started
Mar 29 11:15:50 pve pveproxy[3409687]: worker exit
Mar 29 11:17:01 pve CRON[3411383]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 29 11:17:01 pve CRON[3411384]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 29 11:17:01 pve CRON[3411383]: pam_unix(cron:session): session closed for user root
Mar 29 11:20:32 pve pvedaemon[3355677]: <root@pam> successful auth for user 'root@pam'
Mar 29 11:20:41 pve pvedaemon[3416306]: starting termproxy UPID:pve:003420F2:0739B354:67E801B9:vncshell::root@pam:
Mar 29 11:20:41 pve pvedaemon[3297471]: <root@pam> starting task UPID:pve:003420F2:0739B354:67E801B9:vncshell::root@pam:
Mar 29 11:20:41 pve pvedaemon[3408213]: <root@pam> successful auth for user 'root@pam'
Mar 29 11:20:41 pve login[3416326]: pam_unix(login:session): session opened for user root(uid=0) by root(uid=0)
Mar 29 11:20:41 pve systemd[1]: Created slice user-0.slice - User Slice of UID 0.
Mar 29 11:20:41 pve systemd[1]: Starting user-runtime-dir@0.service - User Runtime Directory /run/user/0...
Mar 29 11:20:41 pve systemd-logind[675]: New session 7739 of user root.
Mar 29 11:20:41 pve systemd[1]: Finished user-runtime-dir@0.service - User Runtime Directory /run/user/0.
Mar 29 11:20:41 pve systemd[1]: Starting user@0.service - User Manager for UID 0...
Mar 29 11:20:41 pve (systemd)[3416332]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0)
Mar 29 11:20:42 pve systemd[3416332]: Queued start job for default target default.target.
Mar 29 11:20:42 pve systemd[3416332]: Created slice app.slice - User Application Slice.
Mar 29 11:20:42 pve systemd[3416332]: Reached target paths.target - Paths.
Mar 29 11:20:42 pve systemd[3416332]: Reached target timers.target - Timers.
Mar 29 11:20:42 pve systemd[3416332]: Starting dbus.socket - D-Bus User Message Bus Socket...
Mar 29 11:20:42 pve systemd[3416332]: Listening on dirmngr.socket - GnuPG network certificate management daemon.
Mar 29 11:20:42 pve systemd[3416332]: Listening on gpg-agent-browser.socket - GnuPG cryptographic agent and passphrase cache (access for web browsers).
Mar 29 11:20:42 pve systemd[3416332]: Listening on gpg-agent-extra.socket - GnuPG cryptographic agent and passphrase cache (restricted).
Mar 29 11:20:42 pve systemd[3416332]: Listening on gpg-agent-ssh.socket - GnuPG cryptographic agent (ssh-agent emulation).
Mar 29 11:20:42 pve systemd[3416332]: Listening on gpg-agent.socket - GnuPG cryptographic agent and passphrase cache.
Mar 29 11:20:42 pve systemd[3416332]: Listening on dbus.socket - D-Bus User Message Bus Socket.
Mar 29 11:20:42 pve systemd[3416332]: Reached target sockets.target - Sockets.
Mar 29 11:20:42 pve systemd[3416332]: Reached target basic.target - Basic System.
Mar 29 11:20:42 pve systemd[3416332]: Reached target default.target - Main User Target.
Mar 29 11:20:42 pve systemd[3416332]: Startup finished in 128ms.
Mar 29 11:20:42 pve systemd[1]: Started user@0.service - User Manager for UID 0.
Mar 29 11:20:42 pve systemd[1]: Started session-7739.scope - Session 7739 of User root.
Mar 29 11:20:42 pve login[3416349]: ROOT LOGIN  on '/dev/pts/0'
Mar 29 11:23:11 pve pveproxy[3298945]: worker exit
Mar 29 11:23:11 pve pveproxy[1064]: worker 3298945 finished
Mar 29 11:23:11 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 11:23:11 pve pveproxy[1064]: worker 3419832 started
Mar 29 11:23:17 pve pveproxy[1064]: worker 3319078 finished
Mar 29 11:23:17 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 11:23:17 pve pveproxy[1064]: worker 3419920 started
Mar 29 11:23:20 pve pveproxy[3419919]: got inotify poll request in wrong process - disabling inotify
Mar 29 11:35:28 pve pvedaemon[3408213]: <root@pam> successful auth for user 'root@pam'
Mar 29 11:44:02 pve systemd-logind[675]: Session 7739 logged out. Waiting for processes to exit.
Mar 29 11:44:02 pve systemd[1]: session-7739.scope: Deactivated successfully.
Mar 29 11:44:02 pve systemd[1]: session-7739.scope: Consumed 18.133s CPU time.
Mar 29 11:44:02 pve systemd-logind[675]: Removed session 7739.
Mar 29 11:44:02 pve pvedaemon[3297471]: <root@pam> end task UPID:pve:003420F2:0739B354:67E801B9:vncshell::root@pam: OK
Mar 29 11:44:03 pve pveproxy[3419919]: worker exit
Mar 29 11:44:13 pve systemd[1]: Stopping user@0.service - User Manager for UID 0...
Mar 29 11:44:13 pve systemd[3416332]: Activating special unit exit.target...
Mar 29 11:44:13 pve systemd[3416332]: Stopped target default.target - Main User Target.
Mar 29 11:44:13 pve systemd[3416332]: Stopped target basic.target - Basic System.
Mar 29 11:44:13 pve systemd[3416332]: Stopped target paths.target - Paths.
Mar 29 11:44:13 pve systemd[3416332]: Stopped target sockets.target - Sockets.
Mar 29 11:44:13 pve systemd[3416332]: Stopped target timers.target - Timers.
Mar 29 11:44:13 pve systemd[3416332]: Closed dbus.socket - D-Bus User Message Bus Socket.
Mar 29 11:44:13 pve systemd[3416332]: Closed dirmngr.socket - GnuPG network certificate management daemon.
Mar 29 11:44:13 pve systemd[3416332]: Closed gpg-agent-browser.socket - GnuPG cryptographic agent and passphrase cache (access for web browsers).
Mar 29 11:44:13 pve systemd[3416332]: Closed gpg-agent-extra.socket - GnuPG cryptographic agent and passphrase cache (restricted).
Mar 29 11:44:13 pve systemd[3416332]: Closed gpg-agent-ssh.socket - GnuPG cryptographic agent (ssh-agent emulation).
Mar 29 11:44:13 pve systemd[3416332]: Closed gpg-agent.socket - GnuPG cryptographic agent and passphrase cache.
Mar 29 11:44:13 pve systemd[3416332]: Removed slice app.slice - User Application Slice.
Mar 29 11:44:13 pve systemd[3416332]: Reached target shutdown.target - Shutdown.
Mar 29 11:44:13 pve systemd[3416332]: Finished systemd-exit.service - Exit the Session.
Mar 29 11:44:13 pve systemd[3416332]: Reached target exit.target - Exit the Session.
Mar 29 11:44:13 pve (sd-pam)[3416333]: pam_unix(systemd-user:session): session closed for user root
Mar 29 11:44:13 pve systemd[1]: user@0.service: Deactivated successfully.
Mar 29 11:44:13 pve systemd[1]: Stopped user@0.service - User Manager for UID 0.
Mar 29 11:44:13 pve systemd[1]: Stopping user-runtime-dir@0.service - User Runtime Directory /run/user/0...
Mar 29 11:44:13 pve systemd[1]: run-user-0.mount: Deactivated successfully.
Mar 29 11:44:13 pve systemd[1]: user-runtime-dir@0.service: Deactivated successfully.
Mar 29 11:44:13 pve systemd[1]: Stopped user-runtime-dir@0.service - User Runtime Directory /run/user/0.
Mar 29 11:44:13 pve systemd[1]: Removed slice user-0.slice - User Slice of UID 0.
Mar 29 11:44:13 pve systemd[1]: user-0.slice: Consumed 18.276s CPU time.
Mar 29 11:59:45 pve pveproxy[1064]: worker 3419832 finished
Mar 29 11:59:45 pve pveproxy[1064]: starting 1 worker(s)
Mar 29 11:59:45 pve pveproxy[1064]: worker 3469323 started
Mar 29 11:59:46 pve pveproxy[3469319]: got inotify poll request in wrong process - disabling inotify
Mar 29 11:59:48 pve pveproxy[3469319]: worker exit


If I restart the VM normally it is enough for everything to return to normal.

I'm not very good at linux so I'm not sure what I need to look for.

Any ideas?
 
somebodyoverthere said:
it seems that the issue is with home assistant not with proxmox.

A simple google search
https://community.home-assistant.io...ber-how-can-i-check-what-is-causing-it/680290
Click to expand...
I don't know if it's related to HA.
The problem first appeared at the end of February.
And since I started monitoring, the only consistent thing is the day and time the problem occurs, always on Saturdays around 8:00.

Some observations that make me believe it's not the same problem:
- I don't use the CPU Speed integration.
- The only times I do backup using HA is when there's an update, I do the backup using proxmox on Sundays.
- I've tried restarting all the integrations and addons, but the only way to get back to normal is to restart HA
- I don't have any automation that runs at this time
- In the topic below the problem appeared after the update to OS 15, my problem started in OS 14.2 and updating to 15 didn't change anything

https://community.home-assistant.io/t/high-cpu-usage-after-update-to-2025-3-3-and-15-0/865363

Another thing is the CPU usage of KVM:
Normal:
Code: 
   1093 root      20   0 9084960   6.0g  13440 S  45.0  19.8 152:35.58 kvm

Issue:
Code: 
3005541 root      20   0    9.9g   5.9g   6784 S 144.5  19.7     77,24 kvm
 
You must log in or register to reply here.
Top Bottom