Immich High CPU and Swap Usage, Cannot Reach Web UI

[qbirdee]

Hi, all. I'm new to Proxmox for my homelab, and appreciate all the great posts here.

I am running Proxmox 8.4, on a NUC n150 with 8gb RAM. Deployed Home Assistant and Plex so far, and figured out kernel updates, GPU passthrough, and external networking. Now Immich has me stumped.

I have given it 3.5GB ram, 512 swap, and 2 cores, using the tteck/Proxmox VE script for Dockge with immich add on. I got everything up and running including gpu passthrough for quicksync and openvino. With the first external library I imported of around 10k images, it ran overnight and did fine.

My second external library of about 12k images is now an issue. My swap and CPU go to 100% utilization all the time, and ram only 2.5gb used. After 3 days and all sorts of tinkering, I'm stuck at the same place.

I can't access Dockge or Immich web UI a minute or so after hard or soft reboots as it seems too many resources are being used up by the import. I have tried following the immich FAQ and limiting threads, setting VM swappiness to 1, using a CPU limit of 1.8 in my Docker file, and finding an odd openvino issue where i had to add a manual ENV variable to avoid an error being thrown for pset affinity.

But, I'm still losing web UI access after a minute, and CPU and Swap go right back up to 100% with plenty of RAM leftover. None of the changes seem to actually do anything. Even after hard reboot.

Open to other suggestions! Thanks in advance for the help.

 

[qbirdee]

Sorry for the long post. Let me simplify.

How do I ratchet down CPU and SWAP usage on a docker container (like Immich) when none of the following seem to help:

1. following the immich FAQ and limiting threads
2. setting VM swappiness to 1
3. using a CPU limit of 1.8 in my Docker file

Is there something within Proxmox to help? Again, I can't even load Dockge within the container as Immich chews up everything when importing images.

Thanks for any thoughts!

 

[cwt]

1.) This is not a Proxmox problem
2.) It’s another thread which ignores all well-known statements (don’t run docker in a LXC and don’t use any helper-script unless you exaclty know what is in it and what it does)

What do expect from your setup? It’s a small system with no severe performance. And running ressource heavy docker containers like Plex or Immich beside other services brings down your N150 (which - I guess - has no internal enterprise ssd drive).

It’s like pulling a truck with your bicycle.