Evaluation not found

[mins317x]

Why don’t I see the Evaluation function when I deploy langfuse locally?

[dosubot[bot]]

Hey @mins317x! 👋 I'm here to help you with any bugs, questions, or to assist you in becoming a contributor. Let's tackle this together!

I found similar discussions that might be relevant to your issue:

1. Evaluations Not Available in Self-Hosted Version?: This discussion mentions that the evaluations tab (online model-based evaluation) is currently in public beta on Langfuse Cloud. It uses some preview infrastructure of Langfuse v3. For self-hosting, model-based evaluations will be part of the commercial version of Langfuse ^[1].

2. Availability of evals when self-hosting: This thread explains that model-based evaluation jobs are in public beta on Langfuse Cloud. When self-hosting, you can run model-based evaluations via the SDKs, and all other evaluation options (via API, manual review in UI) are available without additional infrastructure ^[2].

In your case, since you are using version 2.92.0 OSS, the Evaluation function might not be available because it is part of the features that require the commercial version or are still in beta on the cloud version. You can explore using the SDKs for evaluations or consider the commercial version for full functionality.

To continue talking to Dosu, mention @dosu.

[marcklingen]

Hi @mins317x,

Langfuse evaluation is based on scores (find them in tracing >> scores), docs: https://langfuse.com/docs/scores/overview

All of the underlying data structure and features are OSS. Some additional in-ui features are available on langfuse cloud or under a commercial license when self-hosting. For a full comparison see this page.