Langfuse
Manual annotation queue lables as few shot examples for LLM-as-a-Judge evaluator #4730
jannikmaierhoefer
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
It would be useful, if I could use my annotation queue labels as a few shot examples in the evaluator template. This would allow me to set up a process where I first manually label traces and then hand over this task to the LLM-as-a-Judge for automated continuous evals.
Beta Was this translation helpful? Give feedback.
All reactions