MBox import error large Mbox files #145

New Issue

MrUnknownDE · 2026-04-05T16:16:44+02:00

MrUnknownDE commented

2026-04-05 16:16:44 +02:00

Originally created by @privatscheiss on 10/20/2025

When importing large Mbox files, I get the following error "Cannot create a string longer than 0x1fffffe8 characters"

Mbox file with ImportExportTools NG from Thunderbird.
Mbox file approx. 1.4 GB with approx. 10,000 emails
Smaller Mbox files work without any problems.

Thunderbird 143.0.1
ImportExportTools NG 14.1.14
Windows 11 Pro
Openarchiver 0.3.4 Docker

Log:

`2025-10-20T17:32:37.328814583Z [1] packages/backend start: [17:32:37.260] INFO (264): Backend listening at http://localhost:4000

2025-10-20T17:32:37.574071430Z [0] [0] Ingestion worker started

2025-10-20T17:33:54.745019114Z [0] [0] [17:33:54.578] INFO (297): Starting initial import master job

2025-10-20T17:33:54.745075901Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:33:54.873654031Z [0] [0] [17:33:54.816] INFO (297): Found potential mailbox: 2024.mbox

2025-10-20T17:33:54.875694829Z [0] [0] [17:33:54.816] INFO (297): Adding sync-cycle-finished job to the queue

2025-10-20T17:33:54.875726855Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:33:54.875732702Z [0] [0] userCount: 1

2025-10-20T17:33:54.875737742Z [0] [0] [17:33:54.824] INFO (297): Finished initial import master job

2025-10-20T17:33:54.875749101Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:33:54.875754580Z [0] [0] [17:33:54.829] INFO (297): Processing mailbox for user

2025-10-20T17:33:54.875759885Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:33:54.875764752Z [0] [0] userEmail: "2024.mbox@mbox.local"

2025-10-20T17:34:02.935693113Z [0] [0] [17:34:02.508] ERROR (297): Error processing mailbox

2025-10-20T17:34:02.935751531Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:34:02.935757797Z [0] [0] userEmail: "2024.mbox@mbox.local"

2025-10-20T17:34:02.935762755Z [0] [0] err: {

2025-10-20T17:34:02.935767696Z [0] [0] "type": "Error",

2025-10-20T17:34:02.935773307Z [0] [0] "message": "Cannot create a string longer than 0x1fffffe8 characters",

2025-10-20T17:34:02.935778235Z [0] [0] "stack":

2025-10-20T17:34:02.935783135Z [0] [0] Error: Cannot create a string longer than 0x1fffffe8 characters

2025-10-20T17:34:02.935788024Z [0] [0] at Object.slice (node:buffer:636:37)

2025-10-20T17:34:02.935808360Z [0] [0] at Buffer.toString (node:buffer:864:14)

2025-10-20T17:34:02.935813298Z [0] [0] at MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:50:44)

2025-10-20T17:34:02.935818792Z [0] [0] at process.processTicksAndRejections (node:internal/process/task_queues:105:5)

2025-10-20T17:34:02.935823492Z [0] [0] at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26)

2025-10-20T17:34:02.935828361Z [0] [0] at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32

2025-10-20T17:34:02.935848566Z [0] [0] at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24)

2025-10-20T17:34:02.935852780Z [0] [0] "code": "ERR_STRING_TOO_LONG"

2025-10-20T17:34:02.935856646Z [0] [0] }

2025-10-20T17:34:02.936650428Z [0] [0] [17:34:02.514] INFO (297): Sync cycle finished job started

2025-10-20T17:34:02.936666474Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:34:02.936670752Z [0] [0] userCount: 1

2025-10-20T17:34:02.936674626Z [0] [0] isInitialImport: true

2025-10-20T17:34:02.936678345Z [0] [0] [17:34:02.589] ERROR (297): Sync cycle finished with errors.

2025-10-20T17:34:02.936682645Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124"

2025-10-20T17:34:02.936686629Z [0] [0] errors: "Failed to process mailbox for 2024.mbox@mbox.local: Cannot create a string longer than 0x1fffffe8 characters"`

*Originally created by @privatscheiss on 10/20/2025* When importing large Mbox files, I get the following error "Cannot create a string longer than 0x1fffffe8 characters" Mbox file with ImportExportTools NG from Thunderbird. Mbox file approx. 1.4 GB with approx. 10,000 emails Smaller Mbox files work without any problems. Thunderbird 143.0.1 ImportExportTools NG 14.1.14 Windows 11 Pro Openarchiver 0.3.4 Docker Log: `2025-10-20T17:32:37.328814583Z [1] packages/backend start: [17:32:37.260] INFO (264): Backend listening at http://localhost:4000 2025-10-20T17:32:37.574071430Z [0] [0] Ingestion worker started 2025-10-20T17:33:54.745019114Z [0] [0] [17:33:54.578] INFO (297): Starting initial import master job 2025-10-20T17:33:54.745075901Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:33:54.873654031Z [0] [0] [17:33:54.816] INFO (297): Found potential mailbox: 2024.mbox 2025-10-20T17:33:54.875694829Z [0] [0] [17:33:54.816] INFO (297): Adding sync-cycle-finished job to the queue 2025-10-20T17:33:54.875726855Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:33:54.875732702Z [0] [0] userCount: 1 2025-10-20T17:33:54.875737742Z [0] [0] [17:33:54.824] INFO (297): Finished initial import master job 2025-10-20T17:33:54.875749101Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:33:54.875754580Z [0] [0] [17:33:54.829] INFO (297): Processing mailbox for user 2025-10-20T17:33:54.875759885Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:33:54.875764752Z [0] [0] userEmail: "2024.mbox@mbox.local" 2025-10-20T17:34:02.935693113Z [0] [0] [17:34:02.508] ERROR (297): Error processing mailbox 2025-10-20T17:34:02.935751531Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:34:02.935757797Z [0] [0] userEmail: "2024.mbox@mbox.local" 2025-10-20T17:34:02.935762755Z [0] [0] err: { 2025-10-20T17:34:02.935767696Z [0] [0] "type": "Error", 2025-10-20T17:34:02.935773307Z [0] [0] "message": "Cannot create a string longer than 0x1fffffe8 characters", 2025-10-20T17:34:02.935778235Z [0] [0] "stack": 2025-10-20T17:34:02.935783135Z [0] [0] Error: Cannot create a string longer than 0x1fffffe8 characters 2025-10-20T17:34:02.935788024Z [0] [0] at Object.slice (node:buffer:636:37) 2025-10-20T17:34:02.935808360Z [0] [0] at Buffer.toString (node:buffer:864:14) 2025-10-20T17:34:02.935813298Z [0] [0] at MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:50:44) 2025-10-20T17:34:02.935818792Z [0] [0] at process.processTicksAndRejections (node:internal/process/task_queues:105:5) 2025-10-20T17:34:02.935823492Z [0] [0] at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26) 2025-10-20T17:34:02.935828361Z [0] [0] at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 2025-10-20T17:34:02.935848566Z [0] [0] at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24) 2025-10-20T17:34:02.935852780Z [0] [0] "code": "ERR_STRING_TOO_LONG" 2025-10-20T17:34:02.935856646Z [0] [0] } 2025-10-20T17:34:02.936650428Z [0] [0] [17:34:02.514] INFO (297): Sync cycle finished job started 2025-10-20T17:34:02.936666474Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:34:02.936670752Z [0] [0] userCount: 1 2025-10-20T17:34:02.936674626Z [0] [0] isInitialImport: true 2025-10-20T17:34:02.936678345Z [0] [0] [17:34:02.589] ERROR (297): Sync cycle finished with errors. 2025-10-20T17:34:02.936682645Z [0] [0] ingestionSourceId: "eeb02294-d00a-4c80-ae3f-47db24ffd124" 2025-10-20T17:34:02.936686629Z [0] [0] errors: "Failed to process mailbox for 2024.mbox@mbox.local: Cannot create a string longer than 0x1fffffe8 characters"`

MrUnknownDE added the bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug labels 2026-04-05 16:16:44 +02:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/OpenArchiver#145