Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate various "evals" testapps #1294

Merged
merged 11 commits into from
Nov 21, 2024
Merged

Consolidate various "evals" testapps #1294

merged 11 commits into from
Nov 21, 2024

Conversation

ssbushi
Copy link
Contributor

@ssbushi ssbushi commented Nov 13, 2024

In this PR:

  • Combine cat-eval and eval testapp to evals. This new testapp will be the comprehensive home for eval features.
  • Rename byo-eval to custom-evaluators
  • Delete evaluators-gut-check
  • Tone down on eval focus in rag testapp. rag will have the default genkitEval plugin install to let users dabble with evaluations, but we move other eval plugins / focus into evals testpp.`
  • rag now hosts the pdfQAFirebase flows which showcases using Firestore vector store for RAG.

@ssbushi ssbushi mentioned this pull request Nov 14, 2024
2 tasks
@ssbushi ssbushi marked this pull request as ready for review November 14, 2024 16:15
@ssbushi ssbushi requested a review from pavelgj November 14, 2024 16:15
@ssbushi ssbushi merged commit 9229e7c into main Nov 21, 2024
4 checks passed
@ssbushi ssbushi deleted the sb/fixTestapps branch November 21, 2024 17:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

2 participants