Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Supabase initialization error - due to unfinished supabase-db config, supabase-analytics and related services can't start #4665

Open
mkpanq opened this issue Dec 25, 2024 · 13 comments
Labels
🐛 Bug Reported issues that need to be reproduced by the team. 🔍 Triage Issues that need assessment and prioritization.

Comments

@mkpanq
Copy link

mkpanq commented Dec 25, 2024

Error Message and Logs

I'm adding fresh, out of the box Supabase service using Coolify menu. After initial creation, I'm not changing anything and just click "Deploy":
Everything is going OK, until supabase-db service creation - there is an error during service initialization - service started, but not every init script was properly run.

supabase-db logs:

2024-12-25T12:02:26.412789465Z The files belonging to this database system will be owned by user "postgres".
2024-12-25T12:02:26.412856906Z This user must also own the server process.
2024-12-25T12:02:26.412863626Z 
2024-12-25T12:02:26.413186191Z The database cluster will be initialized with this locale configuration:
2024-12-25T12:02:26.413217272Z   provider:    libc
2024-12-25T12:02:26.413223992Z   LC_COLLATE:  C.UTF-8
2024-12-25T12:02:26.413228712Z   LC_CTYPE:    C.UTF-8
2024-12-25T12:02:26.413232992Z   LC_MESSAGES: en_US.UTF-8
2024-12-25T12:02:26.413237232Z   LC_MONETARY: en_US.UTF-8
2024-12-25T12:02:26.413241392Z   LC_NUMERIC:  en_US.UTF-8
2024-12-25T12:02:26.413245912Z   LC_TIME:     en_US.UTF-8
2024-12-25T12:02:26.413250632Z The default database encoding has accordingly been set to "UTF8".
2024-12-25T12:02:26.413255272Z The default text search configuration will be set to "english".
2024-12-25T12:02:26.413259832Z 
2024-12-25T12:02:26.413263672Z Data page checksums are disabled.
2024-12-25T12:02:26.413267953Z 
2024-12-25T12:02:26.413271873Z fixing permissions on existing directory /var/lib/postgresql/data ... ok
2024-12-25T12:02:26.413828441Z creating subdirectories ... ok
2024-12-25T12:02:26.413985443Z selecting dynamic shared memory implementation ... posix
2024-12-25T12:02:26.440818686Z selecting default max_connections ... 100
2024-12-25T12:02:26.466407750Z selecting default shared_buffers ... 128MB
2024-12-25T12:02:26.483149081Z selecting default time zone ... Etc/UTC
2024-12-25T12:02:26.484556903Z creating configuration files ... ok
2024-12-25T12:02:26.632789407Z running bootstrap script ... ok
2024-12-25T12:02:27.069914968Z performing post-bootstrap initialization ... ok
2024-12-25T12:02:27.198416497Z syncing data to disk ... ok
2024-12-25T12:02:27.198462098Z 
2024-12-25T12:02:27.198468538Z 
2024-12-25T12:02:27.198473058Z Success. You can now start the database server using:
2024-12-25T12:02:27.198477698Z 
2024-12-25T12:02:27.198481538Z     pg_ctl -D /var/lib/postgresql/data -l logfile start
2024-12-25T12:02:27.198485818Z 
2024-12-25T12:02:27.199523554Z initdb: warning: enabling "trust" authentication for local connections
2024-12-25T12:02:27.199658356Z initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
2024-12-25T12:02:27.439698918Z waiting for server to start.... done
2024-12-25T12:02:27.440083324Z server started
2024-12-25T12:02:27.499529136Z 
2024-12-25T12:02:27.499600938Z /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/init-scripts
2024-12-25T12:02:27.499622258Z 
2024-12-25T12:02:27.499625138Z /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/migrate.sh
2024-12-25T12:02:27.502567142Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/00-schema.sql
2024-12-25T12:02:27.548857037Z CREATE ROLE
2024-12-25T12:02:27.551459396Z REVOKE
2024-12-25T12:02:27.553081900Z CREATE SCHEMA
2024-12-25T12:02:27.555328534Z CREATE FUNCTION
2024-12-25T12:02:27.556474951Z REVOKE
2024-12-25T12:02:27.558644824Z GRANT
2024-12-25T12:02:27.558675344Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/00000000000000-initial-schema.sql
2024-12-25T12:02:27.603127331Z CREATE PUBLICATION
2024-12-25T12:02:27.603453576Z CREATE ROLE
2024-12-25T12:02:27.604182947Z ALTER ROLE
2024-12-25T12:02:27.605173802Z CREATE ROLE
2024-12-25T12:02:27.606012335Z CREATE ROLE
2024-12-25T12:02:27.607265914Z GRANT ROLE
2024-12-25T12:02:27.608218768Z CREATE SCHEMA
2024-12-25T12:02:27.614003575Z CREATE EXTENSION
2024-12-25T12:02:27.623886083Z CREATE EXTENSION
2024-12-25T12:02:27.629093881Z CREATE EXTENSION
2024-12-25T12:02:27.629927294Z CREATE ROLE
2024-12-25T12:02:27.630631104Z CREATE ROLE
2024-12-25T12:02:27.631467157Z CREATE ROLE
2024-12-25T12:02:27.632124247Z CREATE ROLE
2024-12-25T12:02:27.632670855Z GRANT ROLE
2024-12-25T12:02:27.633636149Z GRANT ROLE
2024-12-25T12:02:27.634188998Z GRANT ROLE
2024-12-25T12:02:27.634840487Z GRANT ROLE
2024-12-25T12:02:27.635520138Z GRANT
2024-12-25T12:02:27.637334645Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.638325260Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.639391796Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.640733736Z GRANT
2024-12-25T12:02:27.641477707Z ALTER ROLE
2024-12-25T12:02:27.642344480Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.643278454Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.644150787Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.645204123Z ALTER ROLE
2024-12-25T12:02:27.646154017Z ALTER ROLE
2024-12-25T12:02:27.647316795Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/00000000000001-auth-schema.sql
2024-12-25T12:02:27.692098347Z CREATE SCHEMA
2024-12-25T12:02:27.703449237Z CREATE TABLE
2024-12-25T12:02:27.707318215Z CREATE INDEX
2024-12-25T12:02:27.709341966Z CREATE INDEX
2024-12-25T12:02:27.710286500Z COMMENT
2024-12-25T12:02:27.716379711Z CREATE TABLE
2024-12-25T12:02:27.718864829Z CREATE INDEX
2024-12-25T12:02:27.724100787Z CREATE INDEX
2024-12-25T12:02:27.726867469Z CREATE INDEX
2024-12-25T12:02:27.727695441Z COMMENT
2024-12-25T12:02:27.733105122Z CREATE TABLE
2024-12-25T12:02:27.734183898Z COMMENT
2024-12-25T12:02:27.740095827Z CREATE TABLE
2024-12-25T12:02:27.742412942Z CREATE INDEX
2024-12-25T12:02:27.743163593Z COMMENT
2024-12-25T12:02:27.746119438Z CREATE TABLE
2024-12-25T12:02:27.746801008Z COMMENT
2024-12-25T12:02:27.748221469Z INSERT 0 7
2024-12-25T12:02:27.749369926Z CREATE FUNCTION
2024-12-25T12:02:27.750057377Z CREATE FUNCTION
2024-12-25T12:02:27.750834908Z CREATE FUNCTION
2024-12-25T12:02:27.751720202Z GRANT
2024-12-25T12:02:27.752434452Z CREATE ROLE
2024-12-25T12:02:27.753082582Z GRANT
2024-12-25T12:02:27.754018516Z GRANT
2024-12-25T12:02:27.754737207Z GRANT
2024-12-25T12:02:27.755698741Z ALTER ROLE
2024-12-25T12:02:27.757060922Z ALTER TABLE
2024-12-25T12:02:27.758509624Z ALTER TABLE
2024-12-25T12:02:27.759634040Z ALTER TABLE
2024-12-25T12:02:27.760399612Z ALTER TABLE
2024-12-25T12:02:27.761487388Z ALTER TABLE
2024-12-25T12:02:27.762517764Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/00000000000002-storage-schema.sql
2024-12-25T12:02:27.810149239Z CREATE SCHEMA
2024-12-25T12:02:27.811694542Z GRANT
2024-12-25T12:02:27.812993481Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.813768013Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.814863469Z ALTER DEFAULT PRIVILEGES
2024-12-25T12:02:27.828817879Z CREATE TABLE
2024-12-25T12:02:27.828852239Z CREATE INDEX
2024-12-25T12:02:27.834974691Z CREATE TABLE
2024-12-25T12:02:27.838283981Z CREATE INDEX
2024-12-25T12:02:27.841196545Z CREATE INDEX
2024-12-25T12:02:27.842126599Z ALTER TABLE
2024-12-25T12:02:27.843831504Z CREATE FUNCTION
2024-12-25T12:02:27.844793279Z CREATE FUNCTION
2024-12-25T12:02:27.846688347Z CREATE FUNCTION
2024-12-25T12:02:27.848177329Z CREATE FUNCTION
2024-12-25T12:02:27.854196540Z CREATE TABLE
2024-12-25T12:02:27.855103193Z CREATE ROLE
2024-12-25T12:02:27.855794204Z GRANT
2024-12-25T12:02:27.857294226Z GRANT
2024-12-25T12:02:27.857540230Z GRANT
2024-12-25T12:02:27.858403283Z ALTER ROLE
2024-12-25T12:02:27.859838704Z ALTER TABLE
2024-12-25T12:02:27.861060403Z ALTER TABLE
2024-12-25T12:02:27.862191260Z ALTER TABLE
2024-12-25T12:02:27.863488519Z ALTER FUNCTION
2024-12-25T12:02:27.864130129Z ALTER FUNCTION
2024-12-25T12:02:27.865273666Z ALTER FUNCTION
2024-12-25T12:02:27.866321202Z ALTER FUNCTION
2024-12-25T12:02:27.867470419Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/00000000000003-post-setup.sql
2024-12-25T12:02:27.911102274Z ALTER ROLE
2024-12-25T12:02:27.912251331Z ALTER ROLE
2024-12-25T12:02:27.914984572Z CREATE FUNCTION
2024-12-25T12:02:27.916288152Z CREATE EVENT TRIGGER
2024-12-25T12:02:27.917764454Z COMMENT
2024-12-25T12:02:27.919107114Z CREATE FUNCTION
2024-12-25T12:02:27.919832685Z COMMENT
2024-12-25T12:02:27.921570751Z DO
2024-12-25T12:02:27.922233681Z CREATE ROLE
2024-12-25T12:02:27.923128374Z GRANT
2024-12-25T12:02:27.923821145Z GRANT
2024-12-25T12:02:27.924460634Z GRANT
2024-12-25T12:02:27.925043003Z GRANT
2024-12-25T12:02:27.926053498Z GRANT
2024-12-25T12:02:27.926267702Z GRANT
2024-12-25T12:02:27.927296717Z GRANT
2024-12-25T12:02:27.927648802Z GRANT
2024-12-25T12:02:27.927864405Z GRANT
2024-12-25T12:02:27.929678113Z GRANT
2024-12-25T12:02:27.931097894Z GRANT
2024-12-25T12:02:27.934484865Z GRANT
2024-12-25T12:02:27.935897246Z /docker-entrypoint-initdb.d/migrate.sh: running /docker-entrypoint-initdb.d/init-scripts/98-webhooks.sql
2024-12-25T12:02:27.980054909Z psql: error: /docker-entrypoint-initdb.d/init-scripts/98-webhooks.sql: Permission denied
2024-12-25T12:02:28.418001562Z 
2024-12-25T12:02:28.418063283Z PostgreSQL Database directory appears to contain a database; Skipping initialization
2024-12-25T12:02:28.418075963Z 
2024-12-25T12:02:35.062604977Z 10.0.3.6 2024-12-25 12:02:35.061 UTC [49] supabase_admin@_supabase FATAL:  password authentication failed for user "supabase_admin"
2024-12-25T12:02:35.062665977Z 10.0.3.6 2024-12-25 12:02:35.061 UTC [49] supabase_admin@_supabase DETAIL:  User "supabase_admin" has no password assigned.
2024-12-25T12:02:35.062679818Z 	Connection matched pg_hba.conf line 88: "host  all  all  10.0.0.0/8  scram-sha-256"

Because of this, supabase-analytics can't properly start:
supabase-analytics logs:

2024-12-25T12:02:34.045060543Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-25T12:02:34.704624123Z 
2024-12-25T12:02:34.704693284Z 12:02:34.700 [info] Starting migration
2024-12-25T12:02:35.092995513Z 
2024-12-25T12:02:35.093046353Z 12:02:35.092 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:35.093057954Z 
2024-12-25T12:02:35.093062274Z 12:02:35.092 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:36.553599957Z 
2024-12-25T12:02:36.553627717Z 12:02:36.553 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:37.743508578Z 
2024-12-25T12:02:37.743564539Z 12:02:37.742 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:40.178259126Z 
2024-12-25T12:02:40.178313246Z 12:02:40.176 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:43.407266197Z 
2024-12-25T12:02:43.407324918Z 12:02:43.406 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:45.099835085Z 
2024-12-25T12:02:45.099884126Z 12:02:45.096 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-25T12:02:45.968388363Z 
2024-12-25T12:02:45.968441644Z 12:02:45.967 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-25T12:02:45.968448884Z 
2024-12-25T12:02:45.968452564Z   * The database does not exist
2024-12-25T12:02:45.968456004Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-25T12:02:45.968459644Z     migrations, was defined by another library
2024-12-25T12:02:45.968462844Z   * There is a deadlock while migrating (such as using concurrent
2024-12-25T12:02:45.968466124Z     indexes with a migration_lock)
2024-12-25T12:02:45.968469484Z 
2024-12-25T12:02:45.968472364Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-25T12:02:45.968475725Z 
2024-12-25T12:02:45.968478445Z To address the second, you can run "mix ecto.drop" followed by
2024-12-25T12:02:45.968481805Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-25T12:02:45.968508445Z configure Ecto to use another table and/or repository for managing
2024-12-25T12:02:45.968514725Z migrations:
2024-12-25T12:02:45.968517645Z 
2024-12-25T12:02:45.968522605Z     config :logflare, Logflare.Repo,
2024-12-25T12:02:45.968525925Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-25T12:02:45.968531725Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-25T12:02:45.968534845Z 
2024-12-25T12:02:45.968539925Z The full error report is shown below.
2024-12-25T12:02:45.968543486Z 
2024-12-25T12:02:45.982048128Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10957ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-25T12:02:45.982093769Z 
2024-12-25T12:02:45.982097929Z   1. Ensuring your database is available and that you can connect to it
2024-12-25T12:02:45.982100489Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-25T12:02:45.982104369Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-25T12:02:45.982106889Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-25T12:02:45.982109249Z 
2024-12-25T12:02:45.982112729Z See DBConnection.start_link/2 for more information
2024-12-25T12:02:45.982115009Z 
2024-12-25T12:02:45.982116849Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-25T12:02:45.982119049Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-25T12:02:45.982122609Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-25T12:02:45.982124929Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-25T12:02:45.982127129Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-25T12:02:45.982130690Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-25T12:02:45.982133050Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-25T12:02:45.982135250Z     nofile:1: (file)
2024-12-25T12:02:50.068754398Z 

Eventually, supabase-db service is displayed as healthy (because service is running properly), but due to unfinished configuration, supabase-analytics (and the rest of the related services, marked depended in compose file) can't start:

Image

Steps to Reproduce

  1. Create fresh Supabase service (New Resource -> New -> Supabase)
  2. Deploy fresh service instance, without any changes to configuration or compose file
  3. Error is happening as described

Example Repository URL

No response

Coolify Version

v4.0.0-beta.379

Are you using Coolify Cloud?

No (self-hosted)

Operating System and Version (self-hosted)

Ubuntu 24.04.1 LTS (Noble Numbat)

Additional Information

No response

@mkpanq mkpanq added 🐛 Bug Reported issues that need to be reproduced by the team. 🔍 Triage Issues that need assessment and prioritization. labels Dec 25, 2024
@sarnakov
Copy link

I got the same error on my Coolify Cloud

@pongraczi
Copy link

Not a solution, but a report about a working config.

I'm in a test drive with self-hosted coolify on Hetzner (arm64, 2GB RAM), where the target VPS has 8GB RAM (arm64).
The supabase version shipped with coolify v4.0.0-beta.379 was working fine, without problem.
I tested the upgrading process of supabase self-host which went fine (after I fixed a small glitch with pgsodium, which related to supabase itself and nothing to do with coolify, ref.: supabase/supabase#30834 ).

I assume, as the coolify uses the official self-host docker file, it should work in the same way as the supabase self-host.

Anyway, I found this supabase/supabase#30232 , maybe it somehow relates to your issue (and could be related to coolify, too).
In this case the question is, why I got it running without any issue (install + upgrading some supabase images to the latest version).

@y4my4my4m
Copy link

I personally had to change this in docker-compose.yml

analytics:
   # ...
   environment:
      # DB_DATABASE: _supabase    # change this for ↓
      DB_DATABASE: ${POSTGRES_DB}

@mkpanq
Copy link
Author

mkpanq commented Dec 26, 2024

Unfortunately, the problem is still the same... I'll try to look into @pongraczi proposition later

@sudguru
Copy link

sudguru commented Dec 27, 2024

I tried as @y4my4my4m sugessted. I still get the same error:

 Container supabase-analytics-xokso8w4kk4c4kw8ccs804w8  Error
dependency failed to start: container supabase-analytics-xokso8w4kk4c4kw8ccs804w8 is unhealthy

@y4my4my4m , any suggestion?

@pongraczi
Copy link

@y4my4my4m , any suggestion?

What is in your docker log?

Image

@mkpanq
Copy link
Author

mkpanq commented Dec 27, 2024

For newest Coolify version (v4.0.0-beta.380) problem still exists

@sudguru
Copy link

sudguru commented Dec 28, 2024

@pongraczi

Here is my log:

2024-12-28T05:51:01.423665453Z 05:51:01.422 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:01.423667942Z 2024-12-28T05:51:01.423670094Z 05:51:01.422 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:01.440468398Z 2024-12-28T05:51:01.440511368Z 05:51:01.440 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres 2024-12-28T05:51:01.440516554Z ** (EXIT) :invalid_password 2024-12-28T05:51:03.018939365Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"} 2024-12-28T05:51:03.019042167Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}) 2024-12-28T05:51:03.022912395Z 2024-12-28T05:51:03.221143870Z Crash dump is being written to: erl_crash.dump...done 2024-12-28T05:51:03.753497631Z LOGFLARE_NODE_HOST is: 127.0.0.1 2024-12-28T05:51:04.293522707Z 2024-12-28T05:51:04.293552658Z 05:51:04.290 [info] Starting migration 2024-12-28T05:51:04.572612401Z 2024-12-28T05:51:04.572640306Z 05:51:04.572 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:04.572644571Z 2024-12-28T05:51:04.572646923Z 05:51:04.572 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:06.258465628Z 2024-12-28T05:51:06.258485263Z 05:51:06.258 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:06.840563056Z 2024-12-28T05:51:06.840598325Z 05:51:06.840 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:10.152886553Z 2024-12-28T05:51:10.152934115Z 05:51:10.152 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:11.033263163Z 2024-12-28T05:51:11.033298013Z 05:51:11.032 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:15.472830971Z 2024-12-28T05:51:15.472869908Z 05:51:15.472 [error] Could not create schema migrations table. This error usually happens due to the following: 2024-12-28T05:51:15.472873763Z 2024-12-28T05:51:15.472876144Z * The database does not exist 2024-12-28T05:51:15.472878996Z * The "schema_migrations" table, which Ecto uses for managing 2024-12-28T05:51:15.472881714Z migrations, was defined by another library 2024-12-28T05:51:15.472884308Z * There is a deadlock while migrating (such as using concurrent 2024-12-28T05:51:15.472886875Z indexes with a migration_lock) 2024-12-28T05:51:15.472889169Z 2024-12-28T05:51:15.472891419Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV. 2024-12-28T05:51:15.472894105Z 2024-12-28T05:51:15.472896309Z To address the second, you can run "mix ecto.drop" followed by 2024-12-28T05:51:15.472898845Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may 2024-12-28T05:51:15.472901580Z configure Ecto to use another table and/or repository for managing 2024-12-28T05:51:15.472904372Z migrations: 2024-12-28T05:51:15.472906707Z 2024-12-28T05:51:15.472908933Z config :logflare, Logflare.Repo, 2024-12-28T05:51:15.472911281Z migration_source: "some_other_table_for_schema_migrations", 2024-12-28T05:51:15.472913850Z migration_repo: AnotherRepoForSchemaMigrations 2024-12-28T05:51:15.472916165Z 2024-12-28T05:51:15.472918467Z The full error report is shown below. 2024-12-28T05:51:15.472920753Z 2024-12-28T05:51:15.476421970Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10967ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by: 2024-12-28T05:51:15.476463640Z 2024-12-28T05:51:15.476466712Z 1. Ensuring your database is available and that you can connect to it 2024-12-28T05:51:15.476469160Z 2. Tracking down slow queries and making sure they are running fast enough 2024-12-28T05:51:15.476471488Z 3. Increasing the pool_size (although this increases resource consumption) 2024-12-28T05:51:15.476473774Z 4. Allowing requests to wait longer by increasing :queue_target and :queue_interval 2024-12-28T05:51:15.476476197Z 2024-12-28T05:51:15.476478534Z See DBConnection.start_link/2 for more information 2024-12-28T05:51:15.476480983Z 2024-12-28T05:51:15.476483318Z (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1 2024-12-28T05:51:15.476485555Z (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2 2024-12-28T05:51:15.476487867Z (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4 2024-12-28T05:51:15.476490215Z (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3 2024-12-28T05:51:15.476492551Z (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4 2024-12-28T05:51:15.476494871Z (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4 2024-12-28T05:51:15.476497178Z (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3 2024-12-28T05:51:15.476498993Z nofile:1: (file) 2024-12-28T05:51:18.772917699Z 2024-12-28T05:51:18.772967129Z 05:51:18.772 [info] Elixir.Logflare.SigtermHandler is being initialized... 2024-12-28T05:51:18.802141327Z 2024-12-28T05:51:18.802156482Z 05:51:18.801 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802763401Z 2024-12-28T05:51:18.802772503Z 05:51:18.801 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802775631Z 2024-12-28T05:51:18.802777991Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802780874Z 2024-12-28T05:51:18.802783119Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802785920Z 2024-12-28T05:51:18.802788436Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802790928Z 2024-12-28T05:51:18.802800698Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802803165Z 2024-12-28T05:51:18.802805315Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.802807769Z 2024-12-28T05:51:18.802809865Z 05:51:18.802 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.804746028Z 2024-12-28T05:51:18.804756990Z 05:51:18.804 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.804760631Z 2024-12-28T05:51:18.804762856Z 05:51:18.804 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:18.827147770Z 2024-12-28T05:51:18.827163891Z 05:51:18.826 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres 2024-12-28T05:51:18.827167141Z ** (EXIT) :invalid_password 2024-12-28T05:51:20.390561623Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"} 2024-12-28T05:51:20.390607929Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}) 2024-12-28T05:51:20.394765272Z 2024-12-28T05:51:20.590307658Z Crash dump is being written to: erl_crash.dump...done 2024-12-28T05:51:21.075053408Z LOGFLARE_NODE_HOST is: 127.0.0.1 2024-12-28T05:51:21.564239943Z 2024-12-28T05:51:21.564270541Z 05:51:21.559 [info] Starting migration 2024-12-28T05:51:21.844453838Z 2024-12-28T05:51:21.844485008Z 05:51:21.844 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin" 2024-12-28T05:51:21.844488894Z 2024-12-28T05:51:21.844491461Z 05:51:21.844 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"

@pongraczi
Copy link

Are you sure, you have enough resurces and the target folders do not exist before?

2024-12-25T12:02:28.418063283Z PostgreSQL Database directory appears to contain a database; Skipping initialization

I just tried again (4th time) this and I am not able to reproduce:

  • upgrading coolify to the latest version (v4.0.0-beta.380) from the previous (...379)
  • Hetzner VPS, both servers: coolify (arm64, 2GB RAM) and target with supabase+rabbitmq+wiregueard (arm64, 8GB RAM, Ubuntu 24.04.1 LTS)
  • removing previously installed and upgraded supabase (checked with docker volume ls)
  • adding resource to project, selecting target server (supabase-full on target)
  • deploying (I did not change anything)
  • things are cooking (aka deploying)
  • everything are up and running without any problem

Please note:

  • coolify and supabase are on different servers
  • both servers has public ipv4 (if matters)
  • supabase server has 8GB RAM
  • cpus are arm64
  • nothing changed on settings before deploying (for example passwords)

@sarnakov
Copy link

The error didn't appear in my logs: "Database directory appears to contain a database; Skipping initialization"
Debian GNU/Linux 12 (4 CPU, 8 RAM), VPS with x86_64 architecture
Server has public ipv4
Just created new service, so it's clean.

My logs with v4.0.0-beta.380 (Coolify Cloud)

2024-12-29T17:48:45.957679993Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:48:46.866860373Z 
2024-12-29T17:48:46.866898506Z 17:48:46.861 [info] Starting migration
2024-12-29T17:48:47.303280998Z 
2024-12-29T17:48:47.303305829Z 17:48:47.303 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:47.303310053Z 
2024-12-29T17:48:47.303312515Z 17:48:47.303 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:48.695692508Z 
2024-12-29T17:48:48.695709615Z 17:48:48.695 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:49.059511162Z 
2024-12-29T17:48:49.059538307Z 17:48:49.058 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:50.103704147Z 
2024-12-29T17:48:50.103736878Z 17:48:50.102 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:53.668761748Z 
2024-12-29T17:48:53.668782803Z 17:48:53.668 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:54.215451338Z 
2024-12-29T17:48:54.215478324Z 17:48:54.215 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:48:58.099556013Z 
2024-12-29T17:48:58.099576461Z 17:48:58.099 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:48:58.099579841Z 
2024-12-29T17:48:58.099582239Z   * The database does not exist
2024-12-29T17:48:58.099584597Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:48:58.099587248Z     migrations, was defined by another library
2024-12-29T17:48:58.099589586Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:48:58.099592169Z     indexes with a migration_lock)
2024-12-29T17:48:58.099594655Z 
2024-12-29T17:48:58.099596797Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:48:58.099599121Z 
2024-12-29T17:48:58.099601264Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:48:58.099603665Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:48:58.099616141Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:48:58.099618738Z migrations:
2024-12-29T17:48:58.099621107Z 
2024-12-29T17:48:58.099623351Z     config :logflare, Logflare.Repo,
2024-12-29T17:48:58.099625843Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:48:58.099628717Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:48:58.099630924Z 
2024-12-29T17:48:58.099632952Z The full error report is shown below.
2024-12-29T17:48:58.099635286Z 
2024-12-29T17:48:58.106169163Z 
2024-12-29T17:48:58.106172706Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:48:58.106175170Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:48:58.106177569Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:48:58.106179890Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:48:58.106182215Z 
2024-12-29T17:48:58.106184680Z See DBConnection.start_link/2 for more information
2024-12-29T17:48:58.106187074Z 
2024-12-29T17:48:58.106189340Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:48:58.106191706Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:48:58.106194036Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:48:58.106196263Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:48:58.106198707Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:48:58.106200973Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:48:58.106203526Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:48:58.106205929Z     nofile:1: (file)
2024-12-29T17:49:01.426304308Z 
2024-12-29T17:49:01.426357935Z 17:49:01.426 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:49:01.512263454Z 
2024-12-29T17:49:01.512291849Z 17:49:01.512 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:49:01.546855635Z 
2024-12-29T17:49:01.546879330Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547589099Z 
2024-12-29T17:49:01.547611166Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547615153Z 
2024-12-29T17:49:01.547617430Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547620314Z 
2024-12-29T17:49:01.547622528Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547625199Z 
2024-12-29T17:49:01.547627549Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547630195Z 
2024-12-29T17:49:01.547632354Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547634938Z 
2024-12-29T17:49:01.547636977Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547648262Z 
2024-12-29T17:49:01.547651226Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547653930Z 
2024-12-29T17:49:01.547656083Z 17:49:01.546 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.547658593Z 
2024-12-29T17:49:01.547660685Z 17:49:01.547 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:01.573061375Z 
2024-12-29T17:49:01.573074905Z 17:49:01.572 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:49:01.573078224Z     ** (EXIT) :invalid_password
2024-12-29T17:49:01.588402130Z 
2024-12-29T17:49:01.588417261Z 17:49:01.588 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:49:03.121649740Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:49:03.121751123Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:49:03.123984255Z 
2024-12-29T17:49:03.307350949Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:49:03.813545203Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:49:04.359160636Z 
2024-12-29T17:49:04.359187814Z 17:49:04.356 [info] Starting migration
2024-12-29T17:49:04.597439367Z 
2024-12-29T17:49:04.597455820Z 17:49:04.597 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:04.597459394Z 
2024-12-29T17:49:04.597461796Z 17:49:04.597 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:05.986194115Z 
2024-12-29T17:49:05.986211451Z 17:49:05.985 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:06.958654500Z 
2024-12-29T17:49:06.958675262Z 17:49:06.958 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:09.469761416Z 
2024-12-29T17:49:09.469780730Z 17:49:09.469 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:09.688250738Z 
2024-12-29T17:49:09.688261513Z 17:49:09.687 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:14.779626269Z 
2024-12-29T17:49:14.779652803Z 17:49:14.779 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:15.513677068Z 
2024-12-29T17:49:15.513707147Z 17:49:15.513 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:49:15.513711850Z 
2024-12-29T17:49:15.513715087Z   * The database does not exist
2024-12-29T17:49:15.513721582Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:49:15.513724966Z     migrations, was defined by another library
2024-12-29T17:49:15.513728265Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:49:15.513731941Z     indexes with a migration_lock)
2024-12-29T17:49:15.513735010Z 
2024-12-29T17:49:15.513737755Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:49:15.513740835Z 
2024-12-29T17:49:15.513766226Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:49:15.513769682Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:49:15.513772873Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:49:15.513775994Z migrations:
2024-12-29T17:49:15.513778929Z 
2024-12-29T17:49:15.513781632Z     config :logflare, Logflare.Repo,
2024-12-29T17:49:15.513784523Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:49:15.513787617Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:49:15.513790694Z 
2024-12-29T17:49:15.513793478Z The full error report is shown below.
2024-12-29T17:49:15.513796525Z 
2024-12-29T17:49:15.519449394Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10972ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:49:15.519470487Z 
2024-12-29T17:49:15.519474809Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:49:15.519478005Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:49:15.519481010Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:49:15.519484075Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:49:15.519487198Z 
2024-12-29T17:49:15.519489971Z See DBConnection.start_link/2 for more information
2024-12-29T17:49:15.519495893Z 
2024-12-29T17:49:15.519498854Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:49:15.519501945Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:49:15.519505122Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:49:15.519508163Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:49:15.519511155Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:49:15.519514196Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:49:15.519517254Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:49:15.519520266Z     nofile:1: (file)
2024-12-29T17:49:18.755374500Z 
2024-12-29T17:49:18.755399463Z 17:49:18.753 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:49:18.830094109Z 
2024-12-29T17:49:18.830119926Z 17:49:18.829 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:49:18.881223514Z 
2024-12-29T17:49:18.881259654Z 17:49:18.880 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881273966Z 
2024-12-29T17:49:18.881277887Z 17:49:18.880 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881282812Z 
2024-12-29T17:49:18.881286568Z 17:49:18.880 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881294597Z 
2024-12-29T17:49:18.881298336Z 17:49:18.880 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881303044Z 
2024-12-29T17:49:18.881306706Z 17:49:18.880 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881311585Z 
2024-12-29T17:49:18.881315487Z 17:49:18.881 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.881320058Z 
2024-12-29T17:49:18.881323862Z 17:49:18.881 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.882538167Z 
2024-12-29T17:49:18.882553185Z 17:49:18.882 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.883700800Z 
2024-12-29T17:49:18.883711544Z 17:49:18.883 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.886559033Z 
2024-12-29T17:49:18.886567867Z 17:49:18.886 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:18.910492153Z 
2024-12-29T17:49:18.910506964Z 17:49:18.910 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:49:18.910511717Z     ** (EXIT) :invalid_password
2024-12-29T17:49:18.926082099Z 
2024-12-29T17:49:18.926105941Z 17:49:18.925 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:49:20.459573076Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:49:20.459573950Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:49:20.459740508Z 
2024-12-29T17:49:20.648561045Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:49:21.102009488Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:49:21.649816043Z 
2024-12-29T17:49:21.649845114Z 17:49:21.645 [info] Starting migration
2024-12-29T17:49:21.920888801Z 
2024-12-29T17:49:21.920912618Z 17:49:21.920 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:21.920916920Z 
2024-12-29T17:49:21.920919263Z 17:49:21.920 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:23.592782067Z 
2024-12-29T17:49:23.592804703Z 17:49:23.591 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:24.723826542Z 
2024-12-29T17:49:24.723845485Z 17:49:24.723 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:26.688106759Z 
2024-12-29T17:49:26.688122306Z 17:49:26.687 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:27.666505039Z 
2024-12-29T17:49:27.666522650Z 17:49:27.665 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:32.809407262Z 
2024-12-29T17:49:32.809433682Z 17:49:32.809 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:49:32.809437155Z 
2024-12-29T17:49:32.809439285Z   * The database does not exist
2024-12-29T17:49:32.809441463Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:49:32.809443838Z     migrations, was defined by another library
2024-12-29T17:49:32.809445936Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:49:32.809448369Z     indexes with a migration_lock)
2024-12-29T17:49:32.809453405Z 
2024-12-29T17:49:32.809455510Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:49:32.809458595Z 
2024-12-29T17:49:32.809469243Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:49:32.809471768Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:49:32.809473997Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:49:32.809476106Z migrations:
2024-12-29T17:49:32.809478152Z 
2024-12-29T17:49:32.809480282Z     config :logflare, Logflare.Repo,
2024-12-29T17:49:32.809482399Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:49:32.809484702Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:49:32.809487034Z 
2024-12-29T17:49:32.809489083Z The full error report is shown below.
2024-12-29T17:49:32.809491192Z 
2024-12-29T17:49:32.813719918Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10969ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:49:32.813740051Z 
2024-12-29T17:49:32.813742842Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:49:32.813745317Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:49:32.813747646Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:49:32.813750257Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:49:32.813752497Z 
2024-12-29T17:49:32.813760404Z See DBConnection.start_link/2 for more information
2024-12-29T17:49:32.813763528Z 
2024-12-29T17:49:32.813765523Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:49:32.813767693Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:49:32.813769949Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:49:32.813772156Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:49:32.813774488Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:49:32.813776656Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:49:32.813778863Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:49:32.813781723Z     nofile:1: (file)
2024-12-29T17:49:35.857645890Z 
2024-12-29T17:49:35.857674847Z 17:49:35.857 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:49:35.928114481Z 
2024-12-29T17:49:35.928140332Z 17:49:35.927 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:49:35.965395414Z 
2024-12-29T17:49:35.965417866Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965421851Z 
2024-12-29T17:49:35.965424391Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965426922Z 
2024-12-29T17:49:35.965428822Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965431282Z 
2024-12-29T17:49:35.965433339Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965435708Z 
2024-12-29T17:49:35.965437651Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965440157Z 
2024-12-29T17:49:35.965442120Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965444547Z 
2024-12-29T17:49:35.965446457Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965448915Z 
2024-12-29T17:49:35.965450897Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.965453356Z 
2024-12-29T17:49:35.965455348Z 17:49:35.964 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.967130501Z 
2024-12-29T17:49:35.967146006Z 17:49:35.967 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:35.988825769Z 
2024-12-29T17:49:35.988841694Z 17:49:35.988 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:49:35.988844770Z     ** (EXIT) :invalid_password
2024-12-29T17:49:36.003157204Z 
2024-12-29T17:49:36.003176371Z 17:49:36.002 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:49:37.535784949Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:49:37.535849333Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:49:37.540711930Z 
2024-12-29T17:49:37.732110469Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:49:38.209635707Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:49:38.784130046Z 
2024-12-29T17:49:38.784152407Z 17:49:38.780 [info] Starting migration
2024-12-29T17:49:39.079605313Z 
2024-12-29T17:49:39.079624546Z 17:49:39.079 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:39.079628466Z 
2024-12-29T17:49:39.079631112Z 17:49:39.079 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:40.095753589Z 
2024-12-29T17:49:40.095770809Z 17:49:40.095 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:41.418123432Z 
2024-12-29T17:49:41.418148556Z 17:49:41.417 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:42.012224551Z 
2024-12-29T17:49:42.012246311Z 17:49:42.012 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:46.515583246Z 
2024-12-29T17:49:46.515604489Z 17:49:46.515 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:47.692538149Z 
2024-12-29T17:49:47.692555835Z 17:49:47.692 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:49.977111505Z 
2024-12-29T17:49:49.977133515Z 17:49:49.976 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:49:49.977137261Z 
2024-12-29T17:49:49.977139591Z   * The database does not exist
2024-12-29T17:49:49.977142140Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:49:49.977144735Z     migrations, was defined by another library
2024-12-29T17:49:49.977147575Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:49:49.977159669Z     indexes with a migration_lock)
2024-12-29T17:49:49.977162085Z 
2024-12-29T17:49:49.977164173Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:49:49.977166776Z 
2024-12-29T17:49:49.977168972Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:49:49.977171362Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:49:49.977173683Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:49:49.977176054Z migrations:
2024-12-29T17:49:49.977178257Z 
2024-12-29T17:49:49.977180327Z     config :logflare, Logflare.Repo,
2024-12-29T17:49:49.977182623Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:49:49.977185133Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:49:49.977187428Z 
2024-12-29T17:49:49.977189604Z The full error report is shown below.
2024-12-29T17:49:49.977191884Z 
2024-12-29T17:49:49.986417622Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10969ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:49:49.986443923Z 
2024-12-29T17:49:49.986447927Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:49:49.986451422Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:49:49.986458076Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:49:49.986461116Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:49:49.986464685Z 
2024-12-29T17:49:49.986467828Z See DBConnection.start_link/2 for more information
2024-12-29T17:49:49.986470625Z 
2024-12-29T17:49:49.986473377Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:49:49.986476563Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:49:49.986479863Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:49:49.986482912Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:49:49.986486057Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:49:49.986489131Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:49:49.986492050Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:49:49.986495171Z     nofile:1: (file)
2024-12-29T17:49:53.175452108Z 
2024-12-29T17:49:53.175482888Z 17:49:53.175 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:49:53.251948693Z 
2024-12-29T17:49:53.251984419Z 17:49:53.251 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:49:53.285940217Z 
2024-12-29T17:49:53.285960837Z 17:49:53.284 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285964748Z 
2024-12-29T17:49:53.285967144Z 17:49:53.284 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285969985Z 
2024-12-29T17:49:53.285972243Z 17:49:53.284 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285975045Z 
2024-12-29T17:49:53.285977334Z 17:49:53.284 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285979947Z 
2024-12-29T17:49:53.285982455Z 17:49:53.284 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285985430Z 
2024-12-29T17:49:53.285987679Z 17:49:53.285 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285990254Z 
2024-12-29T17:49:53.285992392Z 17:49:53.285 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285995117Z 
2024-12-29T17:49:53.285997350Z 17:49:53.285 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.285999972Z 
2024-12-29T17:49:53.286002307Z 17:49:53.285 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.289285282Z 
2024-12-29T17:49:53.289336888Z 17:49:53.288 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:53.313206321Z 
2024-12-29T17:49:53.313223546Z 17:49:53.313 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:49:53.313227215Z     ** (EXIT) :invalid_password
2024-12-29T17:49:53.331025543Z 
2024-12-29T17:49:53.331057274Z 17:49:53.330 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:49:54.866788969Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:49:54.866818161Z 
2024-12-29T17:49:54.866911974Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:49:55.055399473Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:49:55.499243496Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:49:56.004801818Z 
2024-12-29T17:49:56.004831475Z 17:49:56.001 [info] Starting migration
2024-12-29T17:49:56.248190922Z 
2024-12-29T17:49:56.248215912Z 17:49:56.248 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:56.248220240Z 
2024-12-29T17:49:56.248222711Z 17:49:56.248 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:57.574431068Z 
2024-12-29T17:49:57.574447873Z 17:49:57.573 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:57.735845198Z 
2024-12-29T17:49:57.735868820Z 17:49:57.735 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:49:59.445299986Z 
2024-12-29T17:49:59.445320795Z 17:49:59.444 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:01.384302842Z 
2024-12-29T17:50:01.384353867Z 17:50:01.383 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:01.840666116Z 
2024-12-29T17:50:01.840692190Z 17:50:01.840 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:03.656870707Z 
2024-12-29T17:50:03.656892835Z 17:50:03.655 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:07.148559459Z 
2024-12-29T17:50:07.148589649Z 17:50:07.148 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:50:07.148602144Z 
2024-12-29T17:50:07.148604400Z   * The database does not exist
2024-12-29T17:50:07.148606822Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:50:07.148609202Z     migrations, was defined by another library
2024-12-29T17:50:07.148611299Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:50:07.148613368Z     indexes with a migration_lock)
2024-12-29T17:50:07.148615532Z 
2024-12-29T17:50:07.148617445Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:50:07.148619591Z 
2024-12-29T17:50:07.148621614Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:50:07.148623968Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:50:07.148626239Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:50:07.148628394Z migrations:
2024-12-29T17:50:07.148630989Z 
2024-12-29T17:50:07.148633347Z     config :logflare, Logflare.Repo,
2024-12-29T17:50:07.148635727Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:50:07.148637860Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:50:07.148639927Z 
2024-12-29T17:50:07.148642036Z The full error report is shown below.
2024-12-29T17:50:07.148644210Z 
2024-12-29T17:50:07.154279384Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10973ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:50:07.154299366Z 
2024-12-29T17:50:07.154302040Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:50:07.154304418Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:50:07.154306660Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:50:07.154309082Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:50:07.154311384Z 
2024-12-29T17:50:07.154313412Z See DBConnection.start_link/2 for more information
2024-12-29T17:50:07.154315541Z 
2024-12-29T17:50:07.154317910Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:50:07.154320058Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:50:07.154322275Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:50:07.154324493Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:50:07.154326786Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:50:07.154336691Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:50:07.154338952Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:50:07.154341233Z     nofile:1: (file)
2024-12-29T17:50:10.219625765Z 
2024-12-29T17:50:10.219656943Z 17:50:10.218 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:50:10.303489555Z 
2024-12-29T17:50:10.303511571Z 17:50:10.303 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:50:10.348896452Z 
2024-12-29T17:50:10.348922320Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348925732Z 
2024-12-29T17:50:10.348927892Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348930453Z 
2024-12-29T17:50:10.348932462Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4722.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348934858Z 
2024-12-29T17:50:10.348942328Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348945067Z 
2024-12-29T17:50:10.348947070Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348949518Z 
2024-12-29T17:50:10.348951503Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348953854Z 
2024-12-29T17:50:10.348955793Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invali2024-12-29T17:48:58.106142120Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10922ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:50:10.348958226Z 
2024-12-29T17:50:10.348960267Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348962689Z 
2024-12-29T17:50:10.348964608Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.348967049Z 
2024-12-29T17:50:10.348969222Z 17:50:10.348 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:10.358982318Z 
2024-12-29T17:50:10.358995899Z 17:50:10.358 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:50:10.358998917Z     ** (EXIT) :invalid_password
2024-12-29T17:50:10.375545013Z 
2024-12-29T17:50:10.375564184Z 17:50:10.375 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:50:11.907786775Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:50:11.907943344Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:50:11.910276354Z 
2024-12-29T17:50:12.097334947Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:50:12.549301413Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:50:13.092624170Z 
2024-12-29T17:50:13.092658969Z 17:50:13.089 [info] Starting migration
2024-12-29T17:50:13.340640039Z 
2024-12-29T17:50:13.340663457Z 17:50:13.340 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:13.340667575Z 
2024-12-29T17:50:13.340669903Z 17:50:13.340 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:15.626209679Z 
2024-12-29T17:50:15.626219114Z 17:50:15.626 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:15.649387723Z 
2024-12-29T17:50:15.649402987Z 17:50:15.648 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:18.730308341Z 
2024-12-29T17:50:18.730334098Z 17:50:18.730 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:19.791800087Z 
2024-12-29T17:50:19.791818210Z 17:50:19.791 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:24.240322952Z 
2024-12-29T17:50:24.240345048Z 17:50:24.239 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:50:24.240357783Z 
2024-12-29T17:50:24.240360306Z   * The database does not exist
2024-12-29T17:50:24.240362613Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:50:24.240365071Z     migrations, was defined by another library
2024-12-29T17:50:24.240367393Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:50:24.240369966Z     indexes with a migration_lock)
2024-12-29T17:50:24.240372278Z 
2024-12-29T17:50:24.240374361Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:50:24.240376817Z 
2024-12-29T17:50:24.240378878Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:50:24.240381231Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:50:24.240383732Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:50:24.240386126Z migrations:
2024-12-29T17:50:24.240388366Z 
2024-12-29T17:50:24.240390540Z     config :logflare, Logflare.Repo,
2024-12-29T17:50:24.240392839Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:50:24.240395206Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:50:24.240397413Z 
2024-12-29T17:50:24.240399491Z The full error report is shown below.
2024-12-29T17:50:24.240401743Z 
2024-12-29T17:50:24.248777222Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10965ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:50:24.248795440Z 
2024-12-29T17:50:24.248798529Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:50:24.248800979Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:50:24.248803334Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:50:24.248805776Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:50:24.248808160Z 
2024-12-29T17:50:24.248810444Z See DBConnection.start_link/2 for more information
2024-12-29T17:50:24.248812796Z 
2024-12-29T17:50:24.248814824Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:50:24.248817211Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:50:24.248819565Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:50:24.248821924Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:50:24.248824332Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:50:24.248833822Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:50:24.248836231Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:50:24.248838644Z     nofile:1: (file)
2024-12-29T17:50:27.160296876Z 
2024-12-29T17:50:27.160333516Z 17:50:27.160 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:50:27.242878537Z 
2024-12-29T17:50:27.242901755Z 17:50:27.242 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:50:27.284707769Z 
2024-12-29T17:50:27.284725246Z 17:50:27.283 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284729388Z 
2024-12-29T17:50:27.284731774Z 17:50:27.283 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284734623Z 
2024-12-29T17:50:27.284736787Z 17:50:27.283 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284739640Z 
2024-12-29T17:50:27.284741746Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284744374Z 
2024-12-29T17:50:27.284746519Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284749222Z 
2024-12-29T17:50:27.284890889Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284894391Z 
2024-12-29T17:50:27.284896680Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284899887Z 
2024-12-29T17:50:27.284901927Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.284904431Z 
2024-12-29T17:50:27.284907517Z 17:50:27.284 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.288398972Z 
2024-12-29T17:50:27.288411640Z 17:50:27.288 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:27.313610025Z 
2024-12-29T17:50:27.313630679Z 17:50:27.313 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:50:27.313634144Z     ** (EXIT) :invalid_password
2024-12-29T17:50:27.334581710Z 
2024-12-29T17:50:27.334608442Z 17:50:27.334 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:50:28.867718645Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:50:28.868282959Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:50:28.870427933Z 
2024-12-29T17:50:29.058241387Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:50:29.567971712Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:50:30.094163117Z 
2024-12-29T17:50:30.094195001Z 17:50:30.090 [info] Starting migration
2024-12-29T17:50:30.334227142Z 
2024-12-29T17:50:30.334248925Z 17:50:30.333 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:30.334812307Z 
2024-12-29T17:50:30.334833066Z 17:50:30.334 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:32.080432279Z 
2024-12-29T17:50:32.080447878Z 17:50:32.079 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:32.445251721Z 
2024-12-29T17:50:32.445267708Z 17:50:32.444 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:37.211464597Z 
2024-12-29T17:50:37.211489071Z 17:50:37.210 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:38.651800124Z 
2024-12-29T17:50:38.651827609Z 17:50:38.651 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:41.244663536Z 
2024-12-29T17:50:41.244689395Z 17:50:41.244 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:50:41.244702354Z 
2024-12-29T17:50:41.244704728Z   * The database does not exist
2024-12-29T17:50:41.244836712Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:50:41.244841382Z     migrations, was defined by another library
2024-12-29T17:50:41.244870715Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:50:41.244902529Z     indexes with a migration_lock)
2024-12-29T17:50:41.244920756Z 
2024-12-29T17:50:41.244938825Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:50:41.244971657Z 
2024-12-29T17:50:41.244999818Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:50:41.245021480Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:50:41.245051665Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:50:41.245076608Z migrations:
2024-12-29T17:50:41.245102806Z 
2024-12-29T17:50:41.245136411Z     config :logflare, Logflare.Repo,
2024-12-29T17:50:41.245176798Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:50:41.245207583Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:50:41.245245895Z 
2024-12-29T17:50:41.245279658Z The full error report is shown below.
2024-12-29T17:50:41.245309715Z 
2024-12-29T17:50:41.250339611Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10974ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:50:41.250354964Z 
2024-12-29T17:50:41.250357837Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:50:41.250360221Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:50:41.250362505Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:50:41.250364874Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:50:41.250367107Z 
2024-12-29T17:50:41.250369359Z See DBConnection.start_link/2 for more information
2024-12-29T17:50:41.250371462Z 
2024-12-29T17:50:41.250373820Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:50:41.250376057Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:50:41.250378256Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:50:41.250380481Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:50:41.250382740Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:50:41.250391906Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:50:41.250394231Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:50:41.250396828Z     nofile:1: (file)
2024-12-29T17:50:44.363822022Z 
2024-12-29T17:50:44.363851766Z 17:50:44.363 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:50:44.446038983Z 
2024-12-29T17:50:44.446067171Z 17:50:44.445 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:50:44.490294612Z 
2024-12-29T17:50:44.490315053Z 17:50:44.489 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490675866Z 
2024-12-29T17:50:44.490689507Z 17:50:44.489 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490693039Z 
2024-12-29T17:50:44.490695302Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490697810Z 
2024-12-29T17:50:44.490700268Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490702829Z 
2024-12-29T17:50:44.490704787Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490707144Z 
2024-12-29T17:50:44.490709056Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490711454Z 
2024-12-29T17:50:44.490713359Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490715718Z 
2024-12-29T17:50:44.490717775Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490720201Z 
2024-12-29T17:50:44.490722155Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.490724586Z 
2024-12-29T17:50:44.490726579Z 17:50:44.490 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:44.505949079Z 
2024-12-29T17:50:44.505966676Z 17:50:44.505 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:50:44.505970724Z     ** (EXIT) :invalid_password
2024-12-29T17:50:44.521135912Z 
2024-12-29T17:50:44.521172106Z 17:50:44.520 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:50:46.051916568Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:50:46.052310194Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:50:46.054403599Z 
2024-12-29T17:50:46.251541352Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:50:46.713708480Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:50:47.301405207Z 
2024-12-29T17:50:47.301434133Z 17:50:47.298 [info] Starting migration
2024-12-29T17:50:47.539752790Z 
2024-12-29T17:50:47.539774335Z 17:50:47.539 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:47.539917676Z 
2024-12-29T17:50:47.539923252Z 17:50:47.539 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:49.080825142Z 
2024-12-29T17:50:49.080848247Z 17:50:49.079 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:49.516465967Z 
2024-12-29T17:50:49.516479312Z 17:50:49.516 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:53.491822505Z 
2024-12-29T17:50:53.491841810Z 17:50:53.491 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:54.874246460Z 
2024-12-29T17:50:54.874276998Z 17:50:54.874 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:50:58.442117320Z 
2024-12-29T17:50:58.442146993Z 17:50:58.441 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:50:58.442161366Z 
2024-12-29T17:50:58.442163915Z   * The database does not exist
2024-12-29T17:50:58.442166202Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:50:58.442168475Z     migrations, was defined by another library
2024-12-29T17:50:58.442170607Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:50:58.442172884Z     indexes with a migration_lock)
2024-12-29T17:50:58.442175078Z 
2024-12-29T17:50:58.442177306Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:50:58.442179634Z 
2024-12-29T17:50:58.442181974Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:50:58.442184617Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:50:58.442186908Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:50:58.442189039Z migrations:
2024-12-29T17:50:58.442191110Z 
2024-12-29T17:50:58.442193058Z     config :logflare, Logflare.Repo,
2024-12-29T17:50:58.442195131Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:50:58.442197336Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:50:58.442199539Z 
2024-12-29T17:50:58.442201544Z The full error report is shown below.
2024-12-29T17:50:58.442203665Z 
2024-12-29T17:50:58.447644880Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10974ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:50:58.447666083Z 
2024-12-29T17:50:58.447669240Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:50:58.447671959Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:50:58.447674518Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:50:58.447676825Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:50:58.447679224Z 
2024-12-29T17:50:58.447681491Z See DBConnection.start_link/2 for more information
2024-12-29T17:50:58.447683741Z 
2024-12-29T17:50:58.447685812Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:50:58.447688139Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:50:58.447690781Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:50:58.447693148Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:50:58.447695417Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:50:58.447704994Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:50:58.447707418Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:50:58.447709808Z     nofile:1: (file)
2024-12-29T17:51:01.563573233Z 
2024-12-29T17:51:01.563603050Z 17:51:01.563 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:51:01.638079984Z 
2024-12-29T17:51:01.638103268Z 17:51:01.637 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:51:01.672426861Z 
2024-12-29T17:51:01.672442651Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672446277Z 
2024-12-29T17:51:01.672448632Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672451459Z 
2024-12-29T17:51:01.672453506Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672455935Z 
2024-12-29T17:51:01.672457988Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672460367Z 
2024-12-29T17:51:01.672462352Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672464737Z 
2024-12-29T17:51:01.672466680Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672469189Z 
2024-12-29T17:51:01.672471093Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672473428Z 
2024-12-29T17:51:01.672475467Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.672735130Z 
2024-12-29T17:51:01.672739638Z 17:51:01.672 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.674216738Z 
2024-12-29T17:51:01.674227516Z 17:51:01.674 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:01.699882749Z 
2024-12-29T17:51:01.699899061Z 17:51:01.699 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:51:01.699902638Z     ** (EXIT) :invalid_password
2024-12-29T17:51:01.716719713Z 
2024-12-29T17:51:01.716741006Z 17:51:01.716 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:51:03.249190477Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:51:03.249353408Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:51:03.251921901Z 
2024-12-29T17:51:03.448210078Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:51:03.927802687Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:51:04.422179001Z 
2024-12-29T17:51:04.422204124Z 17:51:04.419 [info] Starting migration
2024-12-29T17:51:04.696608245Z 
2024-12-29T17:51:04.696628178Z 17:51:04.696 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:04.697100028Z 
2024-12-29T17:51:04.697113085Z 17:51:04.696 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:06.416959729Z 
2024-12-29T17:51:06.416988370Z 17:51:06.416 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:06.922530551Z 
2024-12-29T17:51:06.922555466Z 17:51:06.922 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:10.793560803Z 
2024-12-29T17:51:10.793586142Z 17:51:10.792 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:11.569910345Z 
2024-12-29T17:51:11.569937874Z 17:51:11.569 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:15.595474155Z 
2024-12-29T17:51:15.595504250Z 17:51:15.595 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:51:15.595523489Z 
2024-12-29T17:51:15.595526174Z   * The database does not exist
2024-12-29T17:51:15.595528703Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:51:15.595531355Z     migrations, was defined by another library
2024-12-29T17:51:15.595533934Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:51:15.595536430Z     indexes with a migration_lock)
2024-12-29T17:51:15.595538870Z 
2024-12-29T17:51:15.595541114Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:51:15.595543678Z 
2024-12-29T17:51:15.595545739Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:51:15.595548105Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:51:15.595550480Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:51:15.595552815Z migrations:
2024-12-29T17:51:15.595555317Z 
2024-12-29T17:51:15.595583064Z     config :logflare, Logflare.Repo,
2024-12-29T17:51:15.595586292Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:51:15.595588705Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:51:15.595590983Z 
2024-12-29T17:51:15.595593049Z The full error report is shown below.
2024-12-29T17:51:15.595595486Z 
2024-12-29T17:51:15.600330863Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10979ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:51:15.600352907Z 
2024-12-29T17:51:15.600356216Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:51:15.600358716Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:51:15.600361059Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:51:15.600363553Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:51:15.600365848Z 
2024-12-29T17:51:15.600368260Z See DBConnection.start_link/2 for more information
2024-12-29T17:51:15.600370632Z 
2024-12-29T17:51:15.600372751Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:51:15.600375103Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:51:15.600377450Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:51:15.600379696Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:51:15.600382091Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:51:15.600391788Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:51:15.600394306Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:51:15.600396655Z     nofile:1: (file)
2024-12-29T17:51:18.557676477Z 
2024-12-29T17:51:18.557707649Z 17:51:18.556 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:51:18.633411681Z 
2024-12-29T17:51:18.633448432Z 17:51:18.632 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:51:18.686393458Z 
2024-12-29T17:51:18.686408871Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686650803Z 
2024-12-29T17:51:18.686657679Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4728.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686660795Z 
2024-12-29T17:51:18.686663099Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686665877Z 
2024-12-29T17:51:18.686668112Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686670823Z 
2024-12-29T17:51:18.686672852Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4729.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686675634Z 
2024-12-29T17:51:18.686677676Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686680265Z 
2024-12-29T17:51:18.686682380Z 17:51:18.685 [error] Postgrex.Protocol (#PID<0.4721.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686685195Z 
2024-12-29T17:51:18.686687381Z 17:51:18.686 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686690093Z 
2024-12-29T17:51:18.686692227Z 17:51:18.686 [error] Postgrex.Protocol (#PID<0.4730.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.686694809Z 
2024-12-29T17:51:18.686696882Z 17:51:18.686 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:18.691216273Z 
2024-12-29T17:51:18.691233129Z 17:51:18.691 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:51:18.691237897Z     ** (EXIT) :invalid_password
2024-12-29T17:51:18.707840238Z 
2024-12-29T17:51:18.707861101Z 17:51:18.707 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
2024-12-29T17:51:20.254413518Z {"Kernel pid terminated",application_controller,"{application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}}"}
2024-12-29T17:51:20.254558783Z Kernel pid terminated (application_controller) ({application_start_failure,logflare,{{shutdown,{failed_to_start_child,'Elixir.Cainophile.Adapters.Postgres',invalid_password}},{'Elixir.Logflare.Application',start,[normal,[]]}}})
2024-12-29T17:51:20.257256188Z 
2024-12-29T17:51:20.450931870Z Crash dump is being written to: erl_crash.dump...done
2024-12-29T17:51:20.944701531Z LOGFLARE_NODE_HOST is: 127.0.0.1
2024-12-29T17:51:21.493631454Z 
2024-12-29T17:51:21.493653959Z 17:51:21.490 [info] Starting migration
2024-12-29T17:51:21.786339510Z 
2024-12-29T17:51:21.786365425Z 17:51:21.786 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:21.786586766Z 
2024-12-29T17:51:21.786600638Z 17:51:21.786 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:23.284898511Z 
2024-12-29T17:51:23.284923766Z 17:51:23.284 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:24.509378687Z 
2024-12-29T17:51:24.509401988Z 17:51:24.508 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:26.471512482Z 
2024-12-29T17:51:26.471528901Z 17:51:26.471 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:30.400623315Z 
2024-12-29T17:51:30.400640117Z 17:51:30.400 [error] Postgrex.Protocol (#PID<0.163.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:31.731954139Z 
2024-12-29T17:51:31.731969462Z 17:51:31.731 [error] Postgrex.Protocol (#PID<0.162.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:32.684197033Z 
2024-12-29T17:51:32.684223016Z 17:51:32.679 [error] Could not create schema migrations table. This error usually happens due to the following:
2024-12-29T17:51:32.684226712Z 
2024-12-29T17:51:32.684229048Z   * The database does not exist
2024-12-29T17:51:32.684231386Z   * The "schema_migrations" table, which Ecto uses for managing
2024-12-29T17:51:32.684233898Z     migrations, was defined by another library
2024-12-29T17:51:32.684236147Z   * There is a deadlock while migrating (such as using concurrent
2024-12-29T17:51:32.684238646Z     indexes with a migration_lock)
2024-12-29T17:51:32.684240832Z 
2024-12-29T17:51:32.684242932Z To fix the first issue, run "mix ecto.create" for the desired MIX_ENV.
2024-12-29T17:51:32.684245417Z 
2024-12-29T17:51:32.684247663Z To address the second, you can run "mix ecto.drop" followed by
2024-12-29T17:51:32.684250025Z "mix ecto.create", both for the desired MIX_ENV. Alternatively you may
2024-12-29T17:51:32.684252375Z configure Ecto to use another table and/or repository for managing
2024-12-29T17:51:32.684254687Z migrations:
2024-12-29T17:51:32.684256913Z 
2024-12-29T17:51:32.684258957Z     config :logflare, Logflare.Repo,
2024-12-29T17:51:32.684261202Z       migration_source: "some_other_table_for_schema_migrations",
2024-12-29T17:51:32.684263739Z       migration_repo: AnotherRepoForSchemaMigrations
2024-12-29T17:51:32.684266021Z 
2024-12-29T17:51:32.684268199Z The full error report is shown below.
2024-12-29T17:51:32.684270424Z 
2024-12-29T17:51:32.685952154Z ** (DBConnection.ConnectionError) connection not available and request was dropped from queue after 10965ms. This means requests are coming in and your connection pool cannot serve them fast enough. You can address this by:
2024-12-29T17:51:32.685973171Z 
2024-12-29T17:51:32.685976663Z   1. Ensuring your database is available and that you can connect to it
2024-12-29T17:51:32.685979334Z   2. Tracking down slow queries and making sure they are running fast enough
2024-12-29T17:51:32.685981783Z   3. Increasing the pool_size (although this increases resource consumption)
2024-12-29T17:51:32.685984130Z   4. Allowing requests to wait longer by increasing :queue_target and :queue_interval
2024-12-29T17:51:32.685986738Z 
2024-12-29T17:51:32.685988923Z See DBConnection.start_link/2 for more information
2024-12-29T17:51:32.685991571Z 
2024-12-29T17:51:32.685993892Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:913: Ecto.Adapters.SQL.raise_sql_call_error/1
2024-12-29T17:51:32.685996354Z     (elixir 1.14.4) lib/enum.ex:1658: Enum."-map/2-lists^map/1-0-"/2
2024-12-29T17:51:32.686006611Z     (ecto_sql 3.10.1) lib/ecto/adapters/sql.ex:1005: Ecto.Adapters.SQL.execute_ddl/4
2024-12-29T17:51:32.686009207Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:738: Ecto.Migrator.verbose_schema_migration/3
2024-12-29T17:51:32.686011574Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:552: Ecto.Migrator.lock_for_migrations/4
2024-12-29T17:51:32.686013828Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:428: Ecto.Migrator.run/4
2024-12-29T17:51:32.686016066Z     (ecto_sql 3.10.1) lib/ecto/migrator.ex:170: Ecto.Migrator.with_repo/3
2024-12-29T17:51:32.686018401Z     nofile:1: (file)
2024-12-29T17:51:35.707228598Z 
2024-12-29T17:51:35.707254834Z 17:51:35.706 [notice]     :alarm_handler: {:set, {:system_memory_high_watermark, []}}
2024-12-29T17:51:35.788019706Z 
2024-12-29T17:51:35.788043227Z 17:51:35.787 [info] Elixir.Logflare.SigtermHandler is being initialized...
2024-12-29T17:51:35.851023085Z 
2024-12-29T17:51:35.851039704Z 17:51:35.849 [notice] Application logflare exited: Logflare.Application.start(:normal, []) returned an error: shutdown: failed to start child: Cainophile.Adapters.Postgres
2024-12-29T17:51:35.851043290Z     ** (EXIT) :invalid_password
2024-12-29T17:51:35.854206185Z 
2024-12-29T17:51:35.854221393Z 17:51:35.853 [error] Postgrex.Protocol (#PID<0.4727.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854686992Z 
2024-12-29T17:51:35.854698694Z 17:51:35.853 [error] Postgrex.Protocol (#PID<0.4726.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854702089Z 
2024-12-29T17:51:35.854704247Z 17:51:35.854 [error] Postgrex.Protocol (#PID<0.4725.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854706923Z 
2024-12-29T17:51:35.854709046Z 17:51:35.854 [error] Postgrex.Protocol (#PID<0.4720.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854711657Z 
2024-12-29T17:51:35.854713646Z 17:51:35.854 [error] Postgrex.Protocol (#PID<0.4719.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854716030Z 
2024-12-29T17:51:35.854718007Z 17:51:35.854 [error] Postgrex.Protocol (#PID<0.4723.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.854720363Z 
2024-12-29T17:51:35.854722384Z 17:51:35.854 [error] Postgrex.Protocol (#PID<0.4724.0>) failed to connect: ** (Postgrex.Error) FATAL 28P01 (invalid_password) password authentication failed for user "supabase_admin"
2024-12-29T17:51:35.875112234Z 
2024-12-29T17:51:35.875145767Z 17:51:35.874 [notice]     :alarm_handler: {:clear, :system_memory_high_watermark}
d_password) password authentication failed for user "supabase_admin"

@pongraczi
Copy link

The error didn't appear in my logs: "Database directory appears to contain a database; Skipping initialization"

I referred to the original post. :)

Debian GNU/Linux 12 (4 CPU, 8 RAM), VPS with x86_64 architecture Server has public ipv4 Just created new service, so it's clean.

You must be cursed or I am the chosen one. Check below, why.

Test case 1, steps:

  • I bought a new Debian 12 VPS on Hetzner, CX32 (x86_64, 4 vCPU, 8GB RAM)
  • I added to coolify v...380 as server -> validate, install docker -> ok
  • I selected a project/environment and I added new resource to this new server, I renamed the service name and description of the resource (please note, afaik this recreated the compose file)
  • deployed
  • magic started and I got a fully working supabase instance
  • everything fine, no problem detected

Test case 2, steps:

  • deleting previously created and deployed supabase resource on CX32
  • creating new resource, supabase, I changed nothing (I did not touch service name and description)
  • deploying -> images downloaded again etc., normal deploying process
  • everything started as expected, no problem detected

In both cases, I just chose the supabase provided by coolify itself, I did not use any docker file from supabase directly.
Several month ago I remember, there was some bugs in supabase, which prevented the analytics to start, but your (original post) problem not seems exactly that one.

Sorry, I am not able to reproduce the problem even on vps identical to yours, but I hope I gave you some reference (test cases).

Image

@ReflexFox
Copy link

try using centos system deploy supabase

@Mortalife
Copy link

I just upgraded to version v4.0.0-beta.380, some time over the last few versions they changed the file permissions of the /data/coolify folders to 9999:root, before this change everything worked as expected, it appears that changing the group permissions has caused an issue for me.

I checked another version I have running and they're all root:root and the supabase config works as expected.

For full clarity, I'm not having the permission issue as described above, but a permission issue on kong because the volume/api/kong.yml that get's copied to /home/kong/temp.yml is having permission issues therefore the entire stack I had running successfully is now broken.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Reported issues that need to be reproduced by the team. 🔍 Triage Issues that need assessment and prioritization.
Projects
None yet
Development

No branches or pull requests

7 participants