Is there any plan for OpenTelemetry instrumentation?

[febus982]

Having tracing, metrics and logs supported for OpenTelemetry would be a great addition.

[s3rius]

Hello. I think it would be great to have a taskiq instrumentation, but as I understand taskiq already has a simple integration with otlp out of the box. Since we use mainstream libraries for brokers, you can enable instrumentation for those libraries to get all the traces.

[nickderobertis]

We are currently configuring tracing throughout our application, instrumenting the libraries powering brokers helps but the main thing missing here from our perspective is root spans that lasts the lifecycle of a task. Theoretically it should be possible to have the producer of the task start a trace and it be connected to the worker handling the task in a single trace. It seems like the instrumentation for Celery accomplishes this.

Beyond cross-service tracing, not having a root span at the framework level seems to be causing issues for us. We are using FastAPI as our API framework and the instrumentation for that sets a root span for every request automatically. Without having this at the framework level, traces end up without root spans and so we have some traces lasting close to an hour with TaskIQ. Maybe there is a way to fix this on the otel/Tempo side (we are not experts with otel) but everything works as expected for our FastAPI application.

As a workaround for now we've added spans to task workers by wrapping broker.task in our own custom decorator. This seems to allow us to trace our task execution in the worker accurately but we still end up with traces without root spans containing many unrelated spans over a long duration.

[s3rius]

Okay, I got the point. We will look into it.

[ipfans]

It would be better if logfire could be easily integrated. Thank you guys

[febus982]

Logfire is an OpenTelemetry implementation. Instrumenting OpenTelemetry would automatically work on logfire.