mirror of
https://github.com/LogicLabs-OU/OpenArchiver.git
synced 2026-04-05 16:22:01 +02:00
42b0f6e5f1
* Jobs page responsive fix * feat(ingestion): Refactor email indexing into a dedicated background job This commit refactors the email indexing process to improve the performance and reliability of the ingestion pipeline. Previously, email indexing was performed synchronously within the mailbox processing job. This could lead to timeouts and failed ingestion cycles if the indexing step was slow or encountered errors. To address this, the indexing logic has been moved into a separate, dedicated background job queue (`indexingQueue`). Now, the mailbox processor simply adds a batch of emails to this queue. A separate worker then processes the indexing job asynchronously. This decoupling makes the ingestion process more robust: - It prevents slow indexing from blocking or failing the entire mailbox sync. - It allows for better resource management and scalability by handling indexing in a dedicated process. - It improves error handling, as a failed indexing job can be retried independently without affecting the main ingestion flow. Additionally, this commit includes minor documentation updates and removes a premature timeout in the PDF text extraction helper that was causing issues. --------- Co-authored-by: Wayne <5291640+ringoinca@users.noreply.github.com>
