Otel exporter #529

teocns · 2024-11-22T23:47:56Z

Significant performance boost for AgentOps SDK by leveraging on OpenTelemetry as an event publisher

OpenTelemetry Integration

Added OpenTelemetry dependencies for API, SDK, and HTTP exporter
Implemented SessionExporter class to handle span exports
Configured TracerProvider with standard OTEL attributes

Event Handling Improvements

Replaced manual queue-based event system with OTEL spans
Added better event type handling for actions and tools

Deps

opentelemetry-api>=1.22.0,<2.0.0
opentelemetry-sdk>=1.22.0,<2.0.0
opentelemetry-exporter-otlp-proto-http>=1.22.0,<2.0.0

Additioanlly fixes vcrpy installing old version and erroring due to requires-python >= 3.7

refactor(session): simplify jwt check in session method

Signed-off-by: Teo <[email protected]>

…ts own TracerProvider instance;; Shutdown flag is now instance-level Signed-off-by: Teo <[email protected]>

Signed-off-by: Teo <[email protected]>

This reverts commit ab37c47.

Signed-off-by: Teo <[email protected]>

teocns added 12 commits November 21, 2024 23:49

feat(session): integrate OpenTelemetry for event tracing

745b78f

refactor(session): simplify jwt check in session method

remove deprecated header params from HttpClient

0f16593

Signed-off-by: Teo <[email protected]>

refactor(http_client): use header

8e3696a

Move SessionExporter to session

7b1f23c

Signed-off-by: Teo <[email protected]>

draft

1156d93

Signed-off-by: Teo <[email protected]>

refactor(session): update session tracer provider management

96c72f3

rmv sess. tests

543dc05

deactivate console exporter

cb52558

Signed-off-by: Teo <[email protected]>

tests: mock processor to use linear simple span processor (no batch)

ea92035

revert setup fixture and extra tests

de888fe

Signed-off-by: Teo <[email protected]>

refactor(session): restore otel_exporter for span processing

9ee5bb5

test: Enhance assertions in session tests

70e10f4

teocns force-pushed the otel-exporter branch from 9d5d952 to bbbc6ec Compare November 23, 2024 02:12

refactor(session): reorder tracer initialization after session start

e888b71

teocns force-pushed the otel-exporter branch from bbbc6ec to e888b71 Compare November 23, 2024 02:12

This comment was marked as outdated.

Sign in to view

teocns added 3 commits November 22, 2024 20:34

revert TestSingleSession.test_add_tags

78041ca

Signed-off-by: Teo <[email protected]>

revert TestSingleSession.test_session

b713e51

Signed-off-by: Teo <[email protected]>

fix: add missing api_key to endpoint calls

2db1c5c

teocns force-pushed the otel-exporter branch from 5bda685 to 2db1c5c Compare November 23, 2024 02:41

teocns added 8 commits November 22, 2024 20:50

revert: Session._start_session

bf7593d

Signed-off-by: Teo <[email protected]>

match order of execution with original / ease of comparison

1e10dcf

Signed-off-by: Teo <[email protected]>

remove queue attr

19d96f3

Signed-off-by: Teo <[email protected]>

refactor(session): persisted span processor attr;

9b54cdb

flush_now flag

31b6ced

Signed-off-by: Teo <[email protected]>

small improves

c82de5c

Signed-off-by: Teo <[email protected]>

Improve general lifecycle management of OTEL

b794ad9

Signed-off-by: Teo <[email protected]>

Removed class-level state from SessionExporterEach Session now gets i…

b68c1dc

…ts own TracerProvider instance;; Shutdown flag is now instance-level Signed-off-by: Teo <[email protected]>

teocns force-pushed the otel-exporter branch from c9d52da to b68c1dc Compare November 23, 2024 07:27

14 errors

d0b217a

Signed-off-by: Teo <[email protected]>

teocns added 5 commits November 26, 2024 20:08

refactor(event): update ActionEvent constructor for clarity

ab37c47

clean main conftest.py

6031934

Signed-off-by: Teo <[email protected]>

feat(session/exporter): adpater - data parsing logic

e0bc4e6

deprecate/improve test_session

27a4cf6

save

36a725e

Signed-off-by: Teo <[email protected]>

teocns force-pushed the otel-exporter branch from 0d28c98 to 36a725e Compare November 27, 2024 04:09

teocns added 24 commits November 26, 2024 22:11

refactor: rename GenericAdapter to SessionSpanAdapter

6b30e1f

feat(session): preserve original event type in span attrs

20dffe9

refactor: remove unused OTEL setup method

9c42e76

Revert "refactor(event): update ActionEvent constructor for clarity"

0f64639

This reverts commit ab37c47.

skip patch-relevant tests

50fe4ff

move req mocks to general conftest, and apply global mock to HttpClient

39f2038

api: don't access session with accessor

bff94c2

sir fix-a-lot

8e8d173

Signed-off-by: Teo <[email protected]>

feat(session/exporter): add event ID generation logic

1e771a6

reorganize tests

9ba6e78

feat(session): add flush method to session exporter

f35e60a

feat(exporter): add tracer provider for session exporter

b0b6070

legacy seession teests to pass

83d1d85

feat(session): add session_id and api_key to update_session call

1a76b17

Edit typing; session won't be None with start_session

a5edd98

Signed-off-by: Teo <[email protected]>

refactor: reorganize imports and add flush function

ffbbcc8

refactor: remove unused jwt attribute from SessionProtocol

37a4679

legacy session tests: remove all time.sleep() and implement flush()

96cd761

feat(session): add new event types to session state

052e2d7

Use specific event types

177cb8b

simpify exporter adapter

ecd4c83

Signed-off-by: Teo <[email protected]>

cleanup: headers x-agentops-api-key lookup

64337ea

Signed-off-by: Teo <[email protected]>

simplify session

6788e46

Signed-off-by: Teo <[email protected]>

mock_req in higher level

b0f7e7e

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Otel exporter #529

Otel exporter #529

teocns commented Nov 22, 2024 •

edited

Loading

This comment was marked as outdated.

Otel exporter #529

Are you sure you want to change the base?

Otel exporter #529

Conversation

teocns commented Nov 22, 2024 • edited Loading

This comment was marked as outdated.

teocns commented Nov 22, 2024 •

edited

Loading