Support for batched indexing in meilisearch #221

New Issue

MrUnknownDE · 2026-04-05T16:17:08+02:00

MrUnknownDE commented

2026-04-05 16:17:08 +02:00

Originally created by @citadella on 9/15/2025

I'm seeing, within my meilisearch logs, ingestion of emails one-by-one:

2025-09-15T12:18:50.648506Z INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 46916 } processed_in=5.876166608s
2025-09-15T12:18:53.059743Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
2025-09-15T12:18:53.178384Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
2025-09-15T12:18:57.625469Z INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 46917 } processed_in=4.357701502s
2025-09-15T12:18:58.206320Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
2025-09-15T12:18:58.311104Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.

Clearly I have a lot of emails, but it looks like this it taking forever and so would be far better served by lumping these into batches. I don't know if that's an option, but it'd be very nice to have....

*Originally created by @citadella on 9/15/2025* I'm seeing, within my meilisearch logs, ingestion of emails one-by-one: 2025-09-15T12:18:50.648506Z INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 46916 } processed_in=5.876166608s 2025-09-15T12:18:53.059743Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks. 2025-09-15T12:18:53.178384Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks. 2025-09-15T12:18:57.625469Z INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 46917 } processed_in=4.357701502s 2025-09-15T12:18:58.206320Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks. 2025-09-15T12:18:58.311104Z INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks. Clearly I have a lot of emails, but it looks like this it taking forever and so would be far better served by lumping these into batches. I don't know if that's an option, but it'd be very nice to have....

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/OpenArchiver#221