Skip to content
This repository has been archived by the owner on Feb 28, 2025. It is now read-only.

Enable OpenSearch Trace Analytics with the data-prepper #1880

Draft
wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

Enable OpenSearch Trace Analytics with the data-prepper #1880

wants to merge 16 commits into from

Conversation

jaehnri
Copy link
Contributor

@jaehnri jaehnri commented Nov 28, 2023 •
edited
Loading

TODOs:

  • Service maps
  • Figure out data-prepper to OpenSearch authentication
  • Setup ClusterID processor pipeline
  • Batch and memory limiter processor for trace pipeline

jaehnri and others added 16 commits November 20, 2023 17:42
@jaehnri
Use otel-v1-apm-span as trace index
e15aece 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Fix indenting
011350c 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
wip
7c8ce85 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Add dataprepper config
96326e1 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
add loggingdataprepepr again
0dcaecf 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
add log msg
80054e0 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
add reconcile data prepper function
16cf975 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
change dataprepper secret name
2b15dcf 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
change to use opensearch cluster ref
6a645aa 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
add mock versions for username and clusterid
3ac2152 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Make dataprepper pipeline do trace analytics
9955bf2 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Point preprocessor trace pipeline to dataprepper
ab23518 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Change dataprepper reconciliation logic
a389766 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Updata dataprepper from 2.0.1 to 2.2.1
b12f847 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Add batch and memorylimiter processors for trace OTEL pipelines
9ee4602 
Signed-off-by: Joao Henri <[email protected]>
@jaehnri
Make dataprepper use service_map processor
5b53687 
Signed-off-by: Joao Henri <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jaehnri