Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: optimizable LLM function node #35

Merged
merged 54 commits into from
Oct 8, 2024
Merged

WIP: optimizable LLM function node #35

merged 54 commits into from
Oct 8, 2024

Conversation

rizar
Copy link
Collaborator

@rizar rizar commented Sep 29, 2024 •
edited
Loading

see examples/optimize/README.md

TODO:

  • cover the whole agent with a test
  • make input refs creation nicer

@ollmer ollmer self-requested a review October 1, 2024 10:02
ollmer
ollmer reviewed Oct 1, 2024
View reviewed changes
tapeagents/llm_function.py Outdated Show resolved Hide resolved
@rizar
add rag demos as test data
3007ad5
@rizar
rag prompt reproduced!
7f32d5c
@rizar
evaluation on one example works
dca71ef
@rizar
Merge branch 'main' into llm_function
91f25e1
@rizar
move tests to separate file
569ff8c
@rizar
separate examples and tests
6cdf261
@rizar
less verbose logging
5a79111
@rizar
minor tweaks, mostly less verbose logging
4ed3a08
@rizar
run rag agent, evaluate and browser tapes
5a39968
@rizar
fix writing too much
2511a3c
@rizar
add classmethod to get step kind
fdbb11d
@rizar
our own FunctionCall, ToolCall, ToolCalls; less strict signatures
ffea118
@rizar
fix environment to work with parsed arguments
8d1ea52
@rizar
Merge branch 'main' into llm_function
cae6d91
@rizar
first successful pass of agentic rag
171a4cd
@rizar
things start looking good!
680a307
@rizar
refactor and fix retrieval accuracy calc
16c7281
@rizar
agentic rag evaluation
e37d154
@rizar
finish up optimization code
8154511
@rizar
typo
90dbd35
@rizar
better experiment management
f679030
@rizar
add a test for the query prompt - it works
9adbbd2
@rizar
change context rendering
a478494
@rizar rizar requested a review from ollmer October 4, 2024 18:30
ollmer
ollmer reviewed Oct 7, 2024
View reviewed changes
examples/optimize/README.md Outdated Show resolved Hide resolved
ollmer
ollmer reviewed Oct 7, 2024
View reviewed changes
examples/optimize/README.md Outdated Show resolved Hide resolved
ollmer
ollmer reviewed Oct 7, 2024
View reviewed changes
tapeagents/agent.py Outdated Show resolved Hide resolved
@ollmer
Copy link
Collaborator

ollmer commented Oct 7, 2024

That's really great addition! Everything looks great to me, plus a lot of small improvements over the old things. Let's clear things up about demo filtering, and after that, we're ready to merge.

@rizar rizar requested a review from ollmer October 8, 2024 13:00
@rizar rizar merged commit 95cad57 into main Oct 8, 2024
2 checks passed
@ollmer ollmer deleted the llm_function branch October 15, 2024 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ollmer ollmer Awaiting requested review from ollmer

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@rizar @ollmer