Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(links): write span links to Kafka #4601

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

mjq
Copy link
Member

@mjq mjq commented Mar 20, 2025

Note: This PR is a draft until we discuss span schema a bit further - if the schema is going to change we shouldn't create even more things to migrate by encoding links a possibly outdated way in Kafka. EAP isn't ready to start writing links into ClickHouse yet anyway.


Span links were added in #4486, but are currently only accessible as part of transaction events. We would like to get them in EAP. The first step in that process is to add them to serialized Kafka spans.

The integration tests confirm production into Kafka for every current path for links to enter the system:

  • in a transaction event's trace context
  • in a transaction event's child spans
  • in a span envelope item
  • in an otel_span envelope item
  • via OTLP JSON
  • via OTLP gRPC

Note that our version of the opentelemetry-proto Python library is too old to make flags available so not all tests could check the sampled handling. I'll handle that in a future PR.

Span links were added in <PR>, but are currently only accessible as part of
transaction events. We would like to get them in EAP. The first step in that
process is to add them to serialized Kafka spans.

The integration tests confirm production into Kafka for every current path for
links to enter the system:
- in a transaction event's trace context
- in a transaction event's child spans
- in a `span` envelope item
- in an `otel_span` envelope item
- via OTLP JSON
- via OTLP gRPC

Co-authored-by: Lukas Stracke <[email protected]>
Co-authored-by: Sigrid Huemer <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant