[BUG] Docker fail when immich CPU is high

[LonnyX]

The bug

Description

Current Behavior

When the CPU usage reaches a high level on the host machine, Docker fails to perform properly. It make me disconnect from SSH and disconnect every other services and other dockers instances (CasaOS for instance)

Please let me know if there's any additional information needed to address this issue effectively.

Here you an see that immish is started since 7 hours but status keep being restarted

The OS that Immich Server is running on

Raspberry Pi OS Lite 12 (bookworm)

Version of Immich Server

v1.84.0

Version of Immich Mobile App

doesn't matter

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

version: "3.8"

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: ["start.sh", "immich"]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.yml
    #   service: hwaccel
    command: ["start.sh", "microservices"]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  immich-web:
    container_name: immich_web
    image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
    env_file:
      - .env
    restart: always

  typesense:
    container_name: immich_typesense
    image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
    environment:
      - TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
      - TYPESENSE_DATA_DIR=/data
      # remove this to get debug messages
      - GLOG_minloglevel=1
    volumes:
      - tsdata:/data
    restart: always

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    restart: always

  database:
    container_name: immich_postgres
    image: postgres:14-alpine@sha256:28407a9961e76f2d285dc6991e8e48893503cc3836a4755bbc2d40bcc272a441
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

  immich-proxy:
    container_name: immich_proxy
    image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
    ports:
      - 2283:8080
    depends_on:
      - immich-server
      - immich-web
    restart: always

volumes:
  pgdata:
  model-cache:
  tsdata:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/media/devmon/Elements/immich

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=********
DB_PASSWORD=*********

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

IMMICH_MACHINE_LEARNING_URL=false
TYPESENSE_ENABLED=false

Reproduction steps

1. Install immich on Raspberry Pi 4
2. Attempt to run bulk upload 1000 photos & videos
3. Observe the behavior of Docker when the CPU load is high.

Additional information

• Docker version: 24.0.7, build afdd53b
• Machine: Raspberry Pi 4
• External drive is mounted on the machine

[alextran1502]

Hello, you can use this guide to limit the CPU and RAM to the container

https://www.baeldung.com/ops/docker-memory-limit

I advise limit the CPU usage on machine-learning and microservices container

[LonnyX]

@alextran1502
As you can see on my .env I completely turned off the machine learning and typesence service.

How much memory/cpu do you suggest?
Maybe it'll be a good idea to put a .env example for low memory machine like Raspberry Pi

[alextran1502]

You can try 0.8 of CPU. Memory, you can leave it as it is.

[LonnyX]

It looks better but still after 500 uploads, it disconnected me and all other docker instances have failed in same time.
I also have decreased to 1 all jobs concurrency.

Maybe I should try to with 0.5? While speed isn't a priority, it's crucial that the processing remains stable, even if it's slower. This way, Immich can handle tasks one by one without overloading the host machine.

PS: maybe it's related to the proxy because it's only failed during the upload, not during the process (generation of thumbnails, transcoding etc..) What do you think?