index-email-batch job gets stuck, never finishes #108

New Issue

MrUnknownDE · 2026-04-05T16:16:34+02:00

MrUnknownDE commented

2026-04-05 16:16:34 +02:00

Originally created by @jmatraszek on 11/4/2025

Describe the bug
index-email-batch job gets stuck, does not complete nor fail for a couple of hours).

To Reproduce
Not sure what really causes this, but I did:

create 4 generic IMAP ingestions
sync all of them (~70K emails, ~7GB storage)
index-email-batch job with id 6 stuck (as active) for 10+ hours
systemctl restart openarchiver did not help
paused all ingestions
rebooted the LXC container
index-email-batch job id 6 finally gets unstuck and fails, unstucking other queued jobs
30+ jobs gets processed, then index-email-batch job with id 40 gets stuck again

Expected behavior
Eventually all jobs get processed

Screenshots
The first job that got stuck in the morning and only got unstuck after reboot in the evening:

The second job stuck in active:

System:

Open Archiver Version: 0.4.0
Installed as LXC container in Proxmox using this script: https://community-scripts.github.io/ProxmoxVE/scripts?id=open-archiver

Relevant logs:

Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: TT: complementing a missing function tail
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] [23:03:27.092] INFO (527): Successfully indexed email batch
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1]     batchSize: 500
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1]     successfulDocuments: 500
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1]     failedDocuments: 0
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1]     invalidDocuments: 0
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] [23:03:27.097] INFO (527): Starting batch indexing of emails
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1]     batchSize: 500
Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: TT: undefined function: 133
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element
Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: TT: undefined function: 32
Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker.
Nov 04 23:04:00 openarchiver pnpm[366]: [0] [0] Scheduler running: Looking for active or error ingestion sources to sync.

Then nothing really happening in the logs for the next 20 minutes

Additional context
Nothing happening in the meilisearch logs in the meantime.

After yet again LXC container reboot two more jobs were processed (id 41 and 42), then everything stopped. Id 40 still stuck as active:

*Originally created by @jmatraszek on 11/4/2025* **Describe the bug** `index-email-batch` job gets stuck, does not complete nor fail for a couple of hours). **To Reproduce** Not sure what really causes this, but I did: - create 4 generic IMAP ingestions - sync all of them (~70K emails, ~7GB storage) - `index-email-batch` job with id 6 stuck (as active) for 10+ hours - `systemctl restart openarchiver` did not help - paused all ingestions - rebooted the LXC container - `index-email-batch` job id 6 finally gets unstuck and fails, unstucking other queued jobs - 30+ jobs gets processed, then `index-email-batch` job with id 40 gets stuck again **Expected behavior** Eventually all jobs get processed **Screenshots** The first job that got stuck in the morning and only got unstuck after reboot in the evening: <img width="1589" height="567" alt="Image" src="https://github.com/user-attachments/assets/6dbe7cb2-d0c7-47eb-b0f3-52a30e5add24" /> The second job stuck in active: <img width="1579" height="368" alt="Image" src="https://github.com/user-attachments/assets/70a5a8a3-a1a9-430d-aa99-2e3dbb129e24" /> **System:** - Open Archiver Version: 0.4.0 - Installed as LXC container in Proxmox using this script: https://community-scripts.github.io/ProxmoxVE/scripts?id=open-archiver **Relevant logs:** ``` Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: TT: complementing a missing function tail Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] [23:03:27.092] INFO (527): Successfully indexed email batch Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] batchSize: 500 Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] successfulDocuments: 500 Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] failedDocuments: 0 Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] invalidDocuments: 0 Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] [23:03:27.097] INFO (527): Starting batch indexing of emails Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] batchSize: 500 Nov 04 23:03:28 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: TT: undefined function: 133 Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Unsupported: field.type of Link Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: NOT valid form element Nov 04 23:03:30 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: TT: undefined function: 32 Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:03:31 openarchiver pnpm[366]: [0] [1] Warning: Setting up fake worker. Nov 04 23:04:00 openarchiver pnpm[366]: [0] [0] Scheduler running: Looking for active or error ingestion sources to sync. ``` Then nothing really happening in the logs for the next 20 minutes **Additional context** Nothing happening in the meilisearch logs in the meantime. After yet again LXC container reboot two more jobs were processed (id 41 and 42), then everything stopped. Id 40 still stuck as active: <img width="1594" height="729" alt="Image" src="https://github.com/user-attachments/assets/dfbe28ad-47a1-4002-8c83-394a3b5bac68" />

MrUnknownDE added the bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug labels 2026-04-05 16:16:34 +02:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/OpenArchiver#108