Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: optimizable LLM function node #35

Merged
merged 54 commits into from
Oct 8, 2024
Merged

WIP: optimizable LLM function node #35

merged 54 commits into from
Oct 8, 2024

Commits on Sep 27, 2024

  1. initial commit

    @rizar
    rizar committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    ab59bc8 View commit details
    Browse the repository at this point in the history

  2. 2 tests pass!!

    @rizar
    rizar committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    6d06979 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. cot test

    @rizar
    rizar committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    db4dccf View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. function node, function template, agent using both of them

    @rizar
    rizar committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    0f7c137 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. rag + cot agent

    @rizar
    rizar committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    3ffb037 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. add rag demos as test data

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    3007ad5 View commit details
    Browse the repository at this point in the history

  2. rag prompt reproduced!

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    7f32d5c View commit details
    Browse the repository at this point in the history

  3. evaluation on one example works

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    dca71ef View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into llm_function

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    91f25e1 View commit details
    Browse the repository at this point in the history

  5. move tests to separate file

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    569ff8c View commit details
    Browse the repository at this point in the history

  6. separate examples and tests

    @rizar
    rizar committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    6cdf261 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. less verbose logging

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    5a79111 View commit details
    Browse the repository at this point in the history

  2. minor tweaks, mostly less verbose logging

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    4ed3a08 View commit details
    Browse the repository at this point in the history

  3. run rag agent, evaluate and browser tapes

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    5a39968 View commit details
    Browse the repository at this point in the history

  4. fix writing too much

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2511a3c View commit details
    Browse the repository at this point in the history

  5. add classmethod to get step kind

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    fdbb11d View commit details
    Browse the repository at this point in the history

  6. our own FunctionCall, ToolCall, ToolCalls; less strict signatures

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    ffea118 View commit details
    Browse the repository at this point in the history

  7. fix environment to work with parsed arguments

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    8d1ea52 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into llm_function

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    cae6d91 View commit details
    Browse the repository at this point in the history

  9. first successful pass of agentic rag

    @rizar
    rizar committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    171a4cd View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. things start looking good!

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    680a307 View commit details
    Browse the repository at this point in the history

  2. refactor and fix retrieval accuracy calc

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    16c7281 View commit details
    Browse the repository at this point in the history

  3. agentic rag evaluation

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    e37d154 View commit details
    Browse the repository at this point in the history

  4. finish up optimization code

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    8154511 View commit details
    Browse the repository at this point in the history

  5. typo

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    90dbd35 View commit details
    Browse the repository at this point in the history

  6. better experiment management

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    f679030 View commit details
    Browse the repository at this point in the history

  7. add a test for the query prompt - it works

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    9adbbd2 View commit details
    Browse the repository at this point in the history

  8. change context rendering

    @rizar
    rizar committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    a478494 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. add rag examples loading

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    f09b491 View commit details
    Browse the repository at this point in the history

  2. fix tests

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    1606101 View commit details
    Browse the repository at this point in the history

  3. make it all work

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    9d29d22 View commit details
    Browse the repository at this point in the history

  4. make TapeMetadata.result a dict by default

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    22f868c View commit details
    Browse the repository at this point in the history

  5. update the readme

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    c9ebfa7 View commit details
    Browse the repository at this point in the history

  6. fix some of the issues with the notebook

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    4a6c603 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into llm_function

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    cb81121 View commit details
    Browse the repository at this point in the history

  8. fix tape browser

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    045b46d View commit details
    Browse the repository at this point in the history

  9. break up the code

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    ad55d1c View commit details
    Browse the repository at this point in the history

  10. fix launch commands

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    5af9582 View commit details
    Browse the repository at this point in the history

  11. notebook update

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    692434c View commit details
    Browse the repository at this point in the history

  12. remove debug stuff rom the intro

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    1bf0b35 View commit details
    Browse the repository at this point in the history

  13. move out some functionality to tapeagents.optimize

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    0b8446e View commit details
    Browse the repository at this point in the history

  14. remove comment

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e340a45 View commit details
    Browse the repository at this point in the history

  15. typo

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e628de3 View commit details
    Browse the repository at this point in the history

  16. rename a whole bunch of things

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    ec65938 View commit details
    Browse the repository at this point in the history

  17. renaming, type fixes

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    447269c View commit details
    Browse the repository at this point in the history

  18. add a test for optimize.py

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    5bee52a View commit details
    Browse the repository at this point in the history

  19. cute references

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    fdb1a73 View commit details
    Browse the repository at this point in the history

  20. add dspy as a dev dependency

    @rizar
    rizar committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    c39aa51 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2024

  1. force creation of sqlite db

    @rizar
    rizar committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    a218e71 View commit details
    Browse the repository at this point in the history

  2. typo

    @rizar
    rizar committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    645384f View commit details
    Browse the repository at this point in the history

  3. go back after running test in tmp dir

    @rizar
    rizar committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    8276d03 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. small readme fixes

    @rizar
    rizar committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    29f7625 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. rename parse into get_node_runs

    @rizar
    rizar committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3e27217 View commit details
    Browse the repository at this point in the history

  2. regenerate outputs

    @rizar
    rizar committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1c2ce75 View commit details
    Browse the repository at this point in the history