32 Commits

Author SHA1 Message Date
Nawaz Dhandala
147ff47aa2 feat: Add ProfilesService and ingestion service for OpenTelemetry profiles
- Introduced `profiles_service.proto` to define the ProfilesService for exporting resource profiles.
- Implemented `OtelProfilesIngestService` to handle ingestion of profiles, including processing and flushing to the database.
- Created `ProfilesQueueService` to manage profile ingestion jobs.
- Added comprehensive tests for `OtelProfilesIngestService`, covering stack frame resolution, timestamp parsing, and row building for profiles and samples.
2026-03-27 10:15:55 +00:00
Nawaz Dhandala
5f660bae02 feat: refactor table names in analytics models to use AnalyticsTableName enum 2026-03-16 12:43:55 +00:00
Nawaz Dhandala
8f9e5a46fa feat: update column types to MapStringString and BigNumber, and add projections in Log, Metric, and Span models 2026-03-16 12:08:30 +00:00
Nawaz Dhandala
9a47b02a0c feat: upgrade time column to DateTime64 for nanosecond precision in logs 2026-03-16 10:26:03 +00:00
Nawaz Dhandala
28c4eeb6ff feat: Add retentionDate column and TTL support to telemetry models
- Introduced retentionDate column to Log, Metric, Span, and MonitorLog models for per-service data retention.
- Implemented TTL configuration using retentionDate to enable automatic data deletion in ClickHouse.
- Added skip indexes for improved query performance on relevant columns in Log, Span, Metric, and Exception models.
- Updated ingestion services to compute and store retentionDate based on service-specific retention settings.
- Created a data migration to add retentionDate columns and skip indexes to existing telemetry tables.
- Deprecated the cron job for data deletion, transitioning to ClickHouse's native TTL mechanism.
2026-03-12 11:54:26 +00:00
Nawaz Dhandala
1300c4e667 feat(analytics): add materialized view support to analytics models and table management
- add MaterializedView type
- wire materializedViews into AnalyticsBaseModel (constructor param, property, getter/setter)
- implement materialized view processing in AnalyticsTableManagement (validation, existence check, creation)
2025-10-22 18:04:51 +01:00
Nawaz Dhandala
c9e57fcb19 feat(analytics): add Projection type and use typed projections in models and table creation 2025-10-21 15:46:57 +01:00
Simon Larsen
f7464d6807 refactor: add IP and Port types to ColumnType and update related schemas in AnalyticsModelSchema and ModelSchema 2025-06-09 13:45:53 +01:00
Simon Larsen
db16554390 refactor: clean up code formatting and remove unused nested model example in AnalyticsModelSchema 2025-06-09 11:59:55 +01:00
Simon Larsen
41d0c4034d refactor: remove NestedModel support and clean up related code in AnalyticsBaseModel and StatementGenerator 2025-06-09 11:54:58 +01:00
Simon Larsen
2e2ade0b16 refactor: Update import statements for BaseModel in JSONFunctions and BaseModel in UserModel 2024-08-05 12:08:45 -06:00
Simon Larsen
c968156fa7 refactor: Update import statements for ProbeMonitor and ServerMonitor to use ProbeMonitorResponse and ServerMonitorResponse 2024-08-05 11:43:45 -06:00
Simon Larsen
70a2a3993b refactor: Update symbol type to use lowercase 'symbol' in ColumnAccessControl files 2024-06-14 12:09:53 +01:00
Simon Larsen
faf0641503 refactor: Update package.json and Encryption.ts to use latest version of crypto-js 2024-05-29 15:25:09 +01:00
Simon Larsen
906a42c218 Update TableColumnType enum to include JSONArray type 2024-04-22 19:02:03 +01:00
Simon Larsen
99af4fe826 Fix formatting and remove unused imports 2023-11-14 15:24:05 +00:00
Simon Larsen
3023e22de3 refactor common server to add base api for analytics 2023-11-14 14:21:26 +00:00
Simon Larsen
842b0664c7 update long numbers 2023-10-24 10:56:41 +01:00
Simon Larsen
35b949e448 add new models to clickhouse 2023-10-23 20:02:44 +01:00
Simon Larsen
cb0f7bbad5 fix fmt 2023-10-18 17:44:54 +01:00
Simon Larsen
c3c94f3634 add table 2023-10-18 17:43:18 +01:00
Simon Larsen
955141d42e add logs, metrics and spans 2023-10-18 17:28:49 +01:00
Simon Larsen
352c9ffb8e otel save 2023-10-18 13:59:19 +01:00
Simon Larsen
f2d02c4a5a fix fmt 2023-10-02 16:07:49 +01:00
Simon Larsen
62db38520f add find by 2023-10-02 12:13:37 +01:00
Simon Larsen
55fd9a87b9 fix fmt 2023-10-02 11:04:36 +01:00
Simon Larsen
4046da0523 fix model permissions for clickhouse 2023-10-01 14:35:46 +01:00
Simon Larsen
e728501ddb add create by 2023-10-01 12:46:51 +01:00
Simon Larsen
4dc7741289 fix phone number 2023-08-22 09:37:39 +01:00
Simon Larsen
bdc4c5f4f2 add clickhouse service 2023-08-21 17:23:19 +01:00
Simon Larsen
ca30a7b8b6 fix fmt 2023-08-21 12:04:28 +01:00
Simon Larsen
4538b8ff66 add clickhouse base model and service 2023-08-19 22:11:17 +01:00