github/OpenArchiver
1
1
Fork 0
mirror of https://github.com/LogicLabs-OU/OpenArchiver.git synced 2026-04-06 00:31:57 +02:00
Code Issues 161 Packages Projects Releases Wiki Activity

"Cannot create a string longer than 0x1fffffe8 characters" Mbox Ingest Error #160

New Issue
Open
opened 2026-04-05 16:16:48 +02:00 by MrUnknownDE · 0 comments
MrUnknownDE commented 2026-04-05 16:16:48 +02:00
Owner
Copy Link

Originally created by @bkaufx on 10/9/2025

Describe the bug
Trying to ingest an mbox file around 9.5GB. Finally got it to upload the mbox file by using https, and now I'm getting the following errors. "Cannot create a string longer than 0x1fffffe8 characters"

To Reproduce
Steps to reproduce the behavior:

  1. Go to ingestion sources
  2. Click Create New
  3. Select mbox file, allow it to upload for a while
  4. Click Submit
  5. See error "Cannot create a string longer than 0x1fffffe8 characters"

Expected behavior
New ingestion source created and able to browse and search e-mails from the mbox file.

Screenshots
Image

System:

  • Open Archiver Version: 0.3.4

Relevant logs:

open-archiver  | [0] [0] [10:10:52.150] INFO (261): Starting initial import master job
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0] [10:10:52.290] INFO (261): Found potential mailbox: test.mbox
open-archiver  | [0] [0] [10:10:52.290] INFO (261): Adding sync-cycle-finished job to the queue
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userCount: 1
open-archiver  | [0] [0] [10:10:52.291] INFO (261): Finished initial import master job
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0] [10:10:52.292] INFO (261): Processing mailbox for user
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userEmail: "test.mbox@mbox.local"
meilisearch    | 2025-10-09T17:11:03.180657Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=10.6ms time.idle=67.2ms
open-archiver  | [1] packages/frontend start: en
meilisearch    | 2025-10-09T17:11:11.175725Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=275µs time.idle=1.22ms
open-archiver  | [0] [0] [10:11:13.967] ERROR (261): Error processing mailbox
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userEmail: "test.mbox@mbox.local"
open-archiver  | [0] [0]     err: {
open-archiver  | [0] [0]       "type": "Error",
open-archiver  | [0] [0]       "message": "Cannot create a string longer than 0x1fffffe8 characters",
open-archiver  | [0] [0]       "stack":
open-archiver  | [0] [0]           Error: Cannot create a string longer than 0x1fffffe8 characters
open-archiver  | [0] [0]               at Object.slice (node:buffer:636:37)
open-archiver  | [0] [0]               at Buffer.toString (node:buffer:864:14)
open-archiver  | [0] [0]               at MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:50:44)
open-archiver  | [0] [0]               at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
open-archiver  | [0] [0]               at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26)
open-archiver  | [0] [0]               at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32
open-archiver  | [0] [0]               at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24)
open-archiver  | [0] [0]       "code": "ERR_STRING_TOO_LONG"
open-archiver  | [0] [0]     }
open-archiver  | [0] [0] [10:11:13.972] INFO (261): Sync cycle finished job started
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userCount: 1
open-archiver  | [0] [0]     isInitialImport: true
open-archiver  | [0] [0] [10:11:14.019] ERROR (261): Sync cycle finished with errors.
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     errors: "Failed to process mailbox for test.mbox@mbox.local: Cannot create a string longer than 0x1fffffe8 characters"
valkey         | 1:M 09 Oct 2025 17:11:14.027 * 100 changes in 300 seconds. Saving...
valkey         | 1:M 09 Oct 2025 17:11:14.028 * Background saving started by pid 18
valkey         | 18:C 09 Oct 2025 17:11:14.037 * DB saved on disk
valkey         | 18:C 09 Oct 2025 17:11:14.037 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
valkey         | 1:M 09 Oct 2025 17:11:14.128 * Background saving terminated with success
open-archiver  | [1] packages/frontend start: en
meilisearch    | 2025-10-09T17:11:26.811684Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=3.98ms time.idle=60.1ms
open-archiver  | [0] [0] [10:11:45.350] INFO (261): Starting continuous sync job.
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0] [10:11:45.492] INFO (261): Found potential mailbox: test.mbox
open-archiver  | [0] [0] [10:11:45.494] INFO (261): Continuous sync job finished dispatching mailbox jobs.
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0] [10:11:45.495] INFO (261): Processing mailbox for user
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userEmail: "test.mbox@mbox.local"
open-archiver  | [0] [0] [10:11:45.533] ERROR (261): Error processing mailbox
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     userEmail: "test.mbox@mbox.local"
open-archiver  | [0] [0]     err: {
open-archiver  | [0] [0]       "type": "Error",
open-archiver  | [0] [0]       "message": "File not found",
open-archiver  | [0] [0]       "stack":
open-archiver  | [0] [0]           Error: File not found
open-archiver  | [0] [0]               at LocalFileSystemProvider.get (/app/packages/backend/dist/services/storage/LocalFileSystemProvider.js:65:19)
open-archiver  | [0] [0]               at async MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:48:32)
open-archiver  | [0] [0]               at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26)
open-archiver  | [0] [0]               at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32
open-archiver  | [0] [0]               at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24)
open-archiver  | [0] [0]     }
open-archiver  | [0] [0] [10:11:45.534] INFO (261): Sync cycle finished job started
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     isInitialImport: false
open-archiver  | [0] [0] [10:11:45.571] ERROR (261): Sync cycle finished with errors.
open-archiver  | [0] [0]     ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357"
open-archiver  | [0] [0]     errors: "Failed to process mailbox for test.mbox@mbox.local: File not found"

Additional context
I tried to force sync from the ingestion sources list (in screenshot) after I got the first error, and that is where the file not found error is from. I believe only the first error is relevant but I left in everything just in case.

*Originally created by @bkaufx on 10/9/2025* **Describe the bug** Trying to ingest an mbox file around 9.5GB. Finally got it to upload the mbox file by using https, and now I'm getting the following errors. "Cannot create a string longer than 0x1fffffe8 characters" **To Reproduce** Steps to reproduce the behavior: 1. Go to ingestion sources 2. Click Create New 3. Select mbox file, allow it to upload for a while 4. Click Submit 5. See error "Cannot create a string longer than 0x1fffffe8 characters" **Expected behavior** New ingestion source created and able to browse and search e-mails from the mbox file. **Screenshots** <img width="1073" height="259" alt="Image" src="https://github.com/user-attachments/assets/83b1bea9-7830-4987-96ad-bb3ce252cb34" /> **System:** - Open Archiver Version: 0.3.4 **Relevant logs:** ``` open-archiver | [0] [0] [10:10:52.150] INFO (261): Starting initial import master job open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] [10:10:52.290] INFO (261): Found potential mailbox: test.mbox open-archiver | [0] [0] [10:10:52.290] INFO (261): Adding sync-cycle-finished job to the queue open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userCount: 1 open-archiver | [0] [0] [10:10:52.291] INFO (261): Finished initial import master job open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] [10:10:52.292] INFO (261): Processing mailbox for user open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userEmail: "test.mbox@mbox.local" meilisearch | 2025-10-09T17:11:03.180657Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=10.6ms time.idle=67.2ms open-archiver | [1] packages/frontend start: en meilisearch | 2025-10-09T17:11:11.175725Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=275µs time.idle=1.22ms open-archiver | [0] [0] [10:11:13.967] ERROR (261): Error processing mailbox open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userEmail: "test.mbox@mbox.local" open-archiver | [0] [0] err: { open-archiver | [0] [0] "type": "Error", open-archiver | [0] [0] "message": "Cannot create a string longer than 0x1fffffe8 characters", open-archiver | [0] [0] "stack": open-archiver | [0] [0] Error: Cannot create a string longer than 0x1fffffe8 characters open-archiver | [0] [0] at Object.slice (node:buffer:636:37) open-archiver | [0] [0] at Buffer.toString (node:buffer:864:14) open-archiver | [0] [0] at MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:50:44) open-archiver | [0] [0] at process.processTicksAndRejections (node:internal/process/task_queues:105:5) open-archiver | [0] [0] at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26) open-archiver | [0] [0] at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 open-archiver | [0] [0] at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24) open-archiver | [0] [0] "code": "ERR_STRING_TOO_LONG" open-archiver | [0] [0] } open-archiver | [0] [0] [10:11:13.972] INFO (261): Sync cycle finished job started open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userCount: 1 open-archiver | [0] [0] isInitialImport: true open-archiver | [0] [0] [10:11:14.019] ERROR (261): Sync cycle finished with errors. open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] errors: "Failed to process mailbox for test.mbox@mbox.local: Cannot create a string longer than 0x1fffffe8 characters" valkey | 1:M 09 Oct 2025 17:11:14.027 * 100 changes in 300 seconds. Saving... valkey | 1:M 09 Oct 2025 17:11:14.028 * Background saving started by pid 18 valkey | 18:C 09 Oct 2025 17:11:14.037 * DB saved on disk valkey | 18:C 09 Oct 2025 17:11:14.037 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB valkey | 1:M 09 Oct 2025 17:11:14.128 * Background saving terminated with success open-archiver | [1] packages/frontend start: en meilisearch | 2025-10-09T17:11:26.811684Z INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/emails/search query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=3.98ms time.idle=60.1ms open-archiver | [0] [0] [10:11:45.350] INFO (261): Starting continuous sync job. open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] [10:11:45.492] INFO (261): Found potential mailbox: test.mbox open-archiver | [0] [0] [10:11:45.494] INFO (261): Continuous sync job finished dispatching mailbox jobs. open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] [10:11:45.495] INFO (261): Processing mailbox for user open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userEmail: "test.mbox@mbox.local" open-archiver | [0] [0] [10:11:45.533] ERROR (261): Error processing mailbox open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] userEmail: "test.mbox@mbox.local" open-archiver | [0] [0] err: { open-archiver | [0] [0] "type": "Error", open-archiver | [0] [0] "message": "File not found", open-archiver | [0] [0] "stack": open-archiver | [0] [0] Error: File not found open-archiver | [0] [0] at LocalFileSystemProvider.get (/app/packages/backend/dist/services/storage/LocalFileSystemProvider.js:65:19) open-archiver | [0] [0] at async MboxConnector.fetchEmails (/app/packages/backend/dist/services/ingestion-connectors/MboxConnector.js:48:32) open-archiver | [0] [0] at async processMailboxProcessor (/app/packages/backend/dist/jobs/processors/process-mailbox.processor.js:36:26) open-archiver | [0] [0] at async /app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:499:32 open-archiver | [0] [0] at async Worker.retryIfFailed (/app/node_modules/.pnpm/bullmq@5.56.3/node_modules/bullmq/dist/cjs/classes/worker.js:775:24) open-archiver | [0] [0] } open-archiver | [0] [0] [10:11:45.534] INFO (261): Sync cycle finished job started open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] isInitialImport: false open-archiver | [0] [0] [10:11:45.571] ERROR (261): Sync cycle finished with errors. open-archiver | [0] [0] ingestionSourceId: "82aed901-283f-4b44-9323-378fc2fbb357" open-archiver | [0] [0] errors: "Failed to process mailbox for test.mbox@mbox.local: File not found" ``` **Additional context** I tried to force sync from the ingestion sources list (in screenshot) after I got the first error, and that is where the file not found error is from. I believe only the first error is relevant but I left in everything just in case.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
bug
documentation
documentation
duplicate
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
enhancement
good first issue
help wanted
help wanted
help wanted
help wanted
improvement
improvement
question
question
No Label bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
MrUnknownDE
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github/OpenArchiver#160
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?