Indexing failed #53

Open
opened 2026-04-05 16:16:18 +02:00 by MrUnknownDE · 0 comments
Owner

Originally created by @RAFd3vroot on 1/24/2026

The indexing is failing all over again.

To Reproduce
Ingestion source is a 1GB bit eml zip. Import works. After approximately 20min the indexing fails.

Expected behavior
No failures ;)

Screenshots

System:
Proxmox LXC

  • Open Archiver Version: 0.4.1

Relevant logs:
MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24)

Additional context
Body size limit is already at 10G
BODY_SIZE_LIMIT=10G

*Originally created by @RAFd3vroot on 1/24/2026* The indexing is failing all over again. **To Reproduce** Ingestion source is a 1GB bit eml zip. Import works. After approximately 20min the indexing fails. **Expected behavior** No failures ;) **Screenshots** **System:** Proxmox LXC - Open Archiver Version: 0.4.1 **Relevant logs:** `MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24),MeiliSearchApiError: The provided payload reached the size limit. The maximum accepted payload size is 100 MB. at #request (/opt/openarchiver/node_modules/.pnpm/meilisearch@0.51.0/node_modules/meilisearch/dist/cjs/index.cjs:459:13) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async IndexingService.indexEmailBatch (/opt/openarchiver/packages/backend/dist/services/IndexingService.js:127:13) at async default_1 (/opt/openarchiver/packages/backend/dist/jobs/processors/index-email-batch.processor.js:15:5) at async /opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 at async Worker.retryIfFailed (/opt/openarchiver/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24)` **Additional context** Body size limit is already at 10G BODY_SIZE_LIMIT=10G
MrUnknownDE added the bugbugbugbugbugbugbugbugbugbugbugbugbugbug labels 2026-04-05 16:16:18 +02:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github/OpenArchiver#53