feat: Add Google Workspace user filtering and improve worker concurrency #71

New Issue

MrUnknownDE · 2026-04-05T16:16:22+02:00

MrUnknownDE commented

2026-04-05 16:16:22 +02:00

Originally created by @pcc2000 on 12/23/2025

Summary

Google Workspace User Filtering: Added ability to archive only specific users instead of the entire domain by specifying allowed email addresses
Worker Concurrency: Increased ingestion worker concurrency from 1 to 5 parallel jobs for faster processing
Edit Form UX: Improved the ingestion source edit form to clearly indicate when credentials are hidden for security, with helpful placeholder text

Changes

Google Workspace User Filtering

Added allowedUserEmails optional field to GoogleWorkspaceCredentials type
Updated GoogleWorkspaceConnector.listAllUsers() to filter users based on the allowed list
Added UI textarea field for entering allowed emails (one per line)
If empty, archives all users (existing behavior preserved)

Worker Concurrency

Increased BullMQ worker concurrency from 1 to 5 parallel jobs
Allows multiple ingestion sources to sync simultaneously

Edit Form Improvements

Shows notice when editing that credentials are hidden for security
Placeholder text indicates fields are configured
Only updates credentials if new values are provided

Test plan

Create a Google Workspace ingestion with allowed user emails specified
Verify only specified users are archived
Verify empty allowed emails archives all users
Test editing an ingestion source - credentials should show as hidden
Verify multiple ingestion sources can sync in parallel

*Originally created by @pcc2000 on 12/23/2025* ## Summary - **Google Workspace User Filtering**: Added ability to archive only specific users instead of the entire domain by specifying allowed email addresses - **Worker Concurrency**: Increased ingestion worker concurrency from 1 to 5 parallel jobs for faster processing - **Edit Form UX**: Improved the ingestion source edit form to clearly indicate when credentials are hidden for security, with helpful placeholder text ## Changes ### Google Workspace User Filtering - Added `allowedUserEmails` optional field to `GoogleWorkspaceCredentials` type - Updated `GoogleWorkspaceConnector.listAllUsers()` to filter users based on the allowed list - Added UI textarea field for entering allowed emails (one per line) - If empty, archives all users (existing behavior preserved) ### Worker Concurrency - Increased BullMQ worker concurrency from 1 to 5 parallel jobs - Allows multiple ingestion sources to sync simultaneously ### Edit Form Improvements - Shows notice when editing that credentials are hidden for security - Placeholder text indicates fields are configured - Only updates credentials if new values are provided ## Test plan - [ ] Create a Google Workspace ingestion with allowed user emails specified - [ ] Verify only specified users are archived - [ ] Verify empty allowed emails archives all users - [ ] Test editing an ingestion source - credentials should show as hidden - [ ] Verify multiple ingestion sources can sync in parallel

MrUnknownDE referenced this issue

2026-04-05 16:17:12 +02:00

v0.3.0 release #259

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/OpenArchiver#71