Authentik: "failed to connect to authentik backend: dial unix /tmp/authentik-core.sock: connect: no such file or directory"

[TheRealVira]

After setting up Authentik I seem to be getting an error loop:

Dec 29 20:47:58 authentik authentik-server[1988]: {"domain_url": null, "event": "releasing database lock", "level": "info", "logger": "lifecycle.migrate", "pid": 1988, "schema_name": "public", "timestamp": "2024-12-29T19:47:58.381992"}
Dec 29 20:47:58 authentik authentik-server[100]: {"error":"dial unix /tmp/authentik-core.sock: connect: no such file or directory","event":"failed to proxy to backend","level":"warning","logger":"authentik.router","timestamp":"2024-12-29T20:47:58+01:00"}
Dec 29 20:47:58 authentik authentik-server[100]: {"error":"websocket: bad handshake","event":"failed to connect websocket","level":"warning","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:58+01:00"}
Dec 29 20:47:58 authentik authentik-server[100]: {"event":"waiting 128 seconds to reconnect","level":"info","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:58+01:00"}
Dec 29 20:47:58 authentik authentik-server[1988]: {"event": "Starting gunicorn 23.0.0", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.5364044}
Dec 29 20:47:58 authentik authentik-server[1988]: {"event": "Listening at: unix:/tmp/authentik-core.sock (1988)", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.5373394}
Dec 29 20:47:58 authentik authentik-server[1988]: {"event": "Using worker: lifecycle.worker.DjangoUvicornWorker", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.5373962}
Dec 29 20:47:58 authentik authentik-server[2053]: {"event": "Booting worker with pid: 2053", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.5444596}
Dec 29 20:47:58 authentik authentik-server[2057]: {"event": "Booting worker with pid: 2057", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.6333559}
Dec 29 20:47:58 authentik authentik-server[2053]: {"event": "Exception in worker process", "exception": [{"exc_type": "MultipleObjectsReturned", "exc_value": "get() returned more than one CertificateKeyPair -- it returned 2!", "frames": [{"filename": "/usr/local/lib/python3.12/site-packages/gunicorn/arbiter.py", "lineno": 608, "locals": >
Dec 29 20:47:58 authentik authentik-server[2053]: {"event": "Worker exiting (pid: 2053)", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501678.870102}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"websocket: bad handshake","event":"failed to connect websocket","level":"warning","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"event":"waiting 8 seconds to reconnect","level":"info","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[2057]: {"auth_via": "unauthenticated", "domain_url": "localhost", "event": "/-/health/live/", "host": "localhost:8000", "level": "info", "logger": "authentik.asgi", "method": "GET", "pid": 2057, "remote": "255.255.255.255", "request_id": "6114c00683a0428ea66d9c088ce427e8", "runtime": 12, "schema>
Dec 29 20:47:59 authentik authentik-server[2057]: {"auth_via": "secret_key", "domain_url": "0.0.0.0", "event": "/api/v3/outposts/instances/", "host": "0.0.0.0:9000", "level": "info", "logger": "authentik.asgi", "method": "GET", "pid": 2057, "remote": "127.0.0.1", "request_id": "9eb67607f2fb46d9aebbb8fb07f9c3fc", "runtime": 43, "schema_na>
Dec 29 20:47:59 authentik authentik-server[2057]: {"auth_via": "secret_key", "domain_url": "0.0.0.0", "event": "/api/v3/root/config/", "host": "0.0.0.0:9000", "level": "info", "logger": "authentik.asgi", "method": "GET", "pid": 2057, "remote": "127.0.0.1", "request_id": "0a2fd476b700473fa06f36e7a8e5fb13", "runtime": 19, "schema_name": "p>
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"websocket: bad handshake","event":"failed to connect websocket","level":"warning","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"websocket: bad handshake","event":"failed to connect websocket","level":"warning","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"event":"waiting 1 seconds to reconnect","level":"info","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[1988]: {"event": "Worker (pid:2053) exited with code 3", "level": "error", "logger": "gunicorn.error", "timestamp": 1735501679.7425058}
Dec 29 20:47:59 authentik authentik-server[100]: {"event":"Starting Brand TLS Checker","level":"info","logger":"authentik.router.brand_tls","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"event":"updating brand certificates","level":"info","logger":"authentik.router.brand_tls","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[2057]: {"event": "Error while closing socket [Errno 9] Bad file descriptor", "level": "info", "logger": "gunicorn.error", "timestamp": 1735501679.7643225}
Dec 29 20:47:59 authentik authentik-server[2057]: {"auth_via": "secret_key", "domain_url": "0.0.0.0", "event": "/api/v3/core/brands/?page=1&page_size=100", "host": "0.0.0.0:9000", "level": "info", "logger": "authentik.asgi", "method": "GET", "pid": 2057, "remote": "127.0.0.1", "request_id": "a8e08cfdbc364d70a142659063d3e00f", "runtime": >
Dec 29 20:47:59 authentik authentik-server[1988]: {"event": "Worker (pid:2057) was sent SIGTERM!", "level": "error", "logger": "gunicorn.error", "timestamp": 1735501679.872417}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"dial unix /tmp/authentik-core.sock: connect: no such file or directory","event":"failed to proxy to backend","level":"warning","logger":"authentik.router","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"websocket: bad handshake","event":"failed to connect websocket","level":"warning","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"event":"waiting 16 seconds to reconnect","level":"info","logger":"authentik.outpost.ak-api-controller","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"dial unix /tmp/authentik-core.sock: connect: no such file or directory","event":"failed to proxy to backend","level":"warning","logger":"authentik.router","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[100]: {"error":"502 Bad Gateway","event":"Failed to fetch outpost configuration","level":"error","timestamp":"2024-12-29T20:47:59+01:00"}
Dec 29 20:47:59 authentik authentik-server[1988]: {"event": "Shutting down: Master", "level": "error", "logger": "gunicorn.error", "timestamp": 1735501679.9435322}
Dec 29 20:47:59 authentik authentik-server[1988]: {"event": "Reason: Worker failed to boot.", "level": "error", "logger": "gunicorn.error", "timestamp": 1735501679.9435923}
Dec 29 20:48:00 authentik celery[363]: {"event": "TenantAwareScheduler: Sending due task outposts_service_connection_check (authentik.outposts.tasks.outpost_service_connection_monitor) to 1 tenants", "level": "info", "logger": "tenant_schemas_celery.scheduler", "timestamp": 1735501680.002128}

Is anybody else experiencing the same or any similar issues? Specifically this seems to be pretty interesting:

Dec 29 20:47:59 authentik authentik-server[100]: {"error":"dial unix /tmp/authentik-core.sock: connect: no such file or directory","event":"failed to proxy to backend","level":"warning","logger":"authentik.router","timestamp":"2024-12-29T20:47:59+01:00"}

It looks like the authentik-server servicve is trying to access authentik-core, which should be mounted to /tmp/authentik-core.sock. But which service is failing here and what exactly is expected to be mounted on /tmp/authentik-core.sock? I ran a grep commands to search for said service and found the following:

root@authentik:~# grep -Ril "authentik-core" /opt
/opt/authentik/authentik-server
/opt/authentik/lifecycle/gunicorn.conf.py
/opt/authentik/lifecycle/__pycache__/gunicorn.conf.cpython-312.pyc
/opt/authentik/locale/de/LC_MESSAGES/django.mo
/opt/authentik/locale/de/LC_MESSAGES/django.po
/opt/authentik/authentik/root/__pycache__/monitoring.cpython-312.pyc
/opt/authentik/authentik/root/monitoring.py
/opt/authentik/authentik/root/tests.py
/opt/authentik/internal/web/web.go
/opt/authentik/internal/web/metrics.go
grep: /opt/authentik/web/node_modules/@goauthentik/web: warning: recursive directory loop

I am happy to run any commands or share any additional infos if needed.

[TheRealVira]

Hi, just now I was able to resolve the error. It was an issue with how I restored the DB after migration. If anybody is migrating to LXC as well, these are the commands I used to backup and restore the DB:

On my old Portainer instance I ran the following:

sudo docker exec authentik_postgresql.qnec31z2zj4bk6edpbxn41nyq.468u5n2y94d369413n7mpvcni pg_dump -d authentik -U authentik -Fc > backup.dump
rsync backup.dmp root@{IP_OF_NEW_LXC}:~/backup.dump

On the new LXC Authentik instance:

cat /etc/authentik/config.yml
pg_restore --verbose --clean --host=localhost --dbname=authentik --username=authentik backup.dump

DB password is stored in /etc/authentik/config.yml under postgresql.password!