pangolin randomly crashing after update #1359

New Issue

MrUnknownDE · 2026-04-05T19:10:48+02:00

MrUnknownDE commented

2026-04-05 19:10:48 +02:00

Originally created by @scroguard on 6/12/2025

updated from version 1.4.0 --> 1.5.0. the update seemed to proceed without any issues. however, everything randomly crashes when attempting to navigate the admin interface. if i roll back to 1.4.0 the crashing goes away and the system is rock solid again.

update process i used is as follows:

docker compose down
edit docker compose file with new version number
docker compose pull
docker compose up -d

i've even attempted docker compose up -d --force-recreate, this doesn't help.

after some digging, it appears that the db migration script is the cause for the issue. here is a snippet from the logs when it crashes.

pangolin | npm error path /app
pangolin | npm error command failed
pangolin | npm error signal SIGILL
pangolin | npm error command sh -c DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs'
pangolin | npm error A complete log of this run can be found in: /root/.npm/_logs/2025-06-12T17_52_51_446Z-debug-0.log
traefik | 2025-06-12T17:53:09Z ERR Provider error, retrying in 287.208055ms error="cannot fetch configuration data: do fetch request: Get "http://pangolin:3001/api/v1/traefik-config": dial tcp: lookup pangolin on 127.0.0.11:53: no such host" providerName=http
pangolin exited with code 0
traefik | 2025-06-12T17:53:10Z ERR Provider error, retrying in 427.648805ms error="cannot fetch configuration data: do fetch request: Get "http://pangolin:3001/api/v1/traefik-config": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http
pangolin |
pangolin | > @fosrl/pangolin@0.0.0 start:sqlite
pangolin | > DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs'
pangolin |
traefik | 2025-06-12T17:53:10Z ERR Provider error, retrying in 1.058338936s error="cannot fetch configuration data: do fetch request: Get "http://pangolin:3001/api/v1/traefik-config": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http
pangolin | Starting migrations from version 1.5.0
pangolin | Migrations to run:
pangolin | All migrations completed successfully
traefik | 2025-06-12T17:53:11Z ERR Provider error, retrying in 2.44442303s error="cannot fetch configuration data: do fetch request: Get "http://pangolin:3001/api/v1/traefik-config": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http
traefik | 50.193.208.178 - - [12/Jun/2025:17:53:12 +0000] "GET /wpad.dat HTTP/1.1" 404 19 "-" "-" 43 "-" "-" 0ms
traefik | 74.48.6.121 - - [12/Jun/2025:17:53:13 +0000] "GET / HTTP/1.1" 502 11 "-" "-" 44 "next-router@file" "http://pangolin:3002" 1ms

here is the contents of the .npm/_log file the crash references:

0 verbose cli /usr/local/bin/node /usr/local/bin/npm
1 info using npm@10.8.2
2 info using node@v20.19.2
3 silly config load:file:/usr/local/lib/node_modules/npm/npmrc
4 silly config load:file:/app/.npmrc
5 silly config load:file:/root/.npmrc
6 silly config load:file:/usr/local/etc/npmrc
7 verbose title npm run start:sqlite
8 verbose argv "run" "start:sqlite"
9 verbose logfile logs-max:10 dir:/root/.npm/_logs/2025-06-12T17_59_57_319Z-
10 verbose logfile /root/.npm/_logs/2025-06-12T17_59_57_319Z-debug-0.log
11 silly logfile done cleaning log files
12 verbose stack Error: command failed
12 verbose stack at promiseSpawn (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:22:22)
12 verbose stack at spawnWithShell (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:124:10)
12 verbose stack at promiseSpawn (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:12:12)
12 verbose stack at runScriptPkg (/usr/local/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/run-script-pkg.js:77:13)
12 verbose stack at runScript (/usr/local/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/run-script.js:9:12)
12 verbose stack at #run (/usr/local/lib/node_modules/npm/lib/commands/run-script.js:130:13)
12 verbose stack at async RunScript.exec (/usr/local/lib/node_modules/npm/lib/commands/run-script.js:39:7)
12 verbose stack at async Npm.exec (/usr/local/lib/node_modules/npm/lib/npm.js:207:9)
12 verbose stack at async module.exports (/usr/local/lib/node_modules/npm/lib/cli/entry.js:74:5)
13 verbose pkgid @fosrl/pangolin@0.0.0
14 error path /app
15 error command failed
16 error signal SIGILL
17 error command sh -c DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs'
18 verbose cwd /app
19 verbose os Linux 6.1.0-37-amd64
20 verbose node v20.19.2
21 verbose npm v10.8.2
22 verbose exit 1
23 verbose code 1
24 error A complete log of this run can be found in: /root/.npm/_logs/2025-06-12T17_59_57_319Z-debug-0.log

*Originally created by @scroguard on 6/12/2025* updated from version 1.4.0 --> 1.5.0. the update seemed to proceed without any issues. however, everything randomly crashes when attempting to navigate the admin interface. if i roll back to 1.4.0 the crashing goes away and the system is rock solid again. update process i used is as follows: docker compose down edit docker compose file with new version number docker compose pull docker compose up -d i've even attempted docker compose up -d --force-recreate, this doesn't help. after some digging, it appears that the db migration script is the cause for the issue. here is a snippet from the logs when it crashes. pangolin | npm error path /app pangolin | npm error command failed pangolin | npm error signal SIGILL pangolin | npm error command sh -c DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs' pangolin | npm error A complete log of this run can be found in: /root/.npm/_logs/2025-06-12T17_52_51_446Z-debug-0.log traefik | 2025-06-12T17:53:09Z ERR Provider error, retrying in 287.208055ms error="cannot fetch configuration data: do fetch request: Get \"http://pangolin:3001/api/v1/traefik-config\": dial tcp: lookup pangolin on 127.0.0.11:53: no such host" providerName=http pangolin exited with code 0 traefik | 2025-06-12T17:53:10Z ERR Provider error, retrying in 427.648805ms error="cannot fetch configuration data: do fetch request: Get \"http://pangolin:3001/api/v1/traefik-config\": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http pangolin | pangolin | > @fosrl/pangolin@0.0.0 start:sqlite pangolin | > DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs' pangolin | traefik | 2025-06-12T17:53:10Z ERR Provider error, retrying in 1.058338936s error="cannot fetch configuration data: do fetch request: Get \"http://pangolin:3001/api/v1/traefik-config\": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http pangolin | Starting migrations from version 1.5.0 pangolin | Migrations to run: pangolin | All migrations completed successfully traefik | 2025-06-12T17:53:11Z ERR Provider error, retrying in 2.44442303s error="cannot fetch configuration data: do fetch request: Get \"http://pangolin:3001/api/v1/traefik-config\": dial tcp 172.18.0.2:3001: connect: connection refused" providerName=http traefik | 50.193.208.178 - - [12/Jun/2025:17:53:12 +0000] "GET /wpad.dat HTTP/1.1" 404 19 "-" "-" 43 "-" "-" 0ms traefik | 74.48.6.121 - - [12/Jun/2025:17:53:13 +0000] "GET / HTTP/1.1" 502 11 "-" "-" 44 "next-router@file" "http://pangolin:3002" 1ms here is the contents of the .npm/_log file the crash references: 0 verbose cli /usr/local/bin/node /usr/local/bin/npm 1 info using npm@10.8.2 2 info using node@v20.19.2 3 silly config load:file:/usr/local/lib/node_modules/npm/npmrc 4 silly config load:file:/app/.npmrc 5 silly config load:file:/root/.npmrc 6 silly config load:file:/usr/local/etc/npmrc 7 verbose title npm run start:sqlite 8 verbose argv "run" "start:sqlite" 9 verbose logfile logs-max:10 dir:/root/.npm/_logs/2025-06-12T17_59_57_319Z- 10 verbose logfile /root/.npm/_logs/2025-06-12T17_59_57_319Z-debug-0.log 11 silly logfile done cleaning log files 12 verbose stack Error: command failed 12 verbose stack at promiseSpawn (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:22:22) 12 verbose stack at spawnWithShell (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:124:10) 12 verbose stack at promiseSpawn (/usr/local/lib/node_modules/npm/node_modules/@npmcli/promise-spawn/lib/index.js:12:12) 12 verbose stack at runScriptPkg (/usr/local/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/run-script-pkg.js:77:13) 12 verbose stack at runScript (/usr/local/lib/node_modules/npm/node_modules/@npmcli/run-script/lib/run-script.js:9:12) 12 verbose stack at #run (/usr/local/lib/node_modules/npm/lib/commands/run-script.js:130:13) 12 verbose stack at async RunScript.exec (/usr/local/lib/node_modules/npm/lib/commands/run-script.js:39:7) 12 verbose stack at async Npm.exec (/usr/local/lib/node_modules/npm/lib/npm.js:207:9) 12 verbose stack at async module.exports (/usr/local/lib/node_modules/npm/lib/cli/entry.js:74:5) 13 verbose pkgid @fosrl/pangolin@0.0.0 14 error path /app 15 error command failed 16 error signal SIGILL 17 error command sh -c DB_TYPE=sqlite NODE_OPTIONS=--enable-source-maps NODE_ENV=development ENVIRONMENT=prod sh -c 'node dist/migrations.mjs && node dist/server.mjs' 18 verbose cwd /app 19 verbose os Linux 6.1.0-37-amd64 20 verbose node v20.19.2 21 verbose npm v10.8.2 22 verbose exit 1 23 verbose code 1 24 error A complete log of this run can be found in: /root/.npm/_logs/2025-06-12T17_59_57_319Z-debug-0.log

MrUnknownDE closed this issue

2026-04-05 19:10:48 +02:00

Sign in to join this conversation.

Branches Tags

main

dev

dependabot/npm_and_yarn/dev-minor-updates-b4e5d6b9c5

revert-2766-feature/systemd-install-instructions

dependabot/npm_and_yarn/prod-patch-updates-05702d39f2

dependabot/npm_and_yarn/next-16.2.1

dependabot/npm_and_yarn/recharts-3.8.1

alerting-rules

private-site-ha

dependabot/docker/docker/library/node-25-slim

ssh

delete-account

msg-delivery

org-only-idp

cicd

patch

site-targets-auto-login

No Label

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/pangolin#1359