Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

An eval pipeline for reporting token specific perplexities #334

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
Draft

An eval pipeline for reporting token specific perplexities #334

wants to merge 10 commits into from

Commits on Oct 18, 2023

  1. ppl per token per subdomain

    @IanMagnusson
    IanMagnusson committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    795406d View commit details
    Browse the repository at this point in the history

  2. Truncate long sheet titles

    @IanMagnusson
    IanMagnusson committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    5f0cca0 View commit details
    Browse the repository at this point in the history

  3. try left truncation

    @IanMagnusson
    IanMagnusson committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    a45b553 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. Try one row per token

    @IanMagnusson
    IanMagnusson committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    9a13a96 View commit details
    Browse the repository at this point in the history

  2. one sheet per task for token ppls

    @IanMagnusson
    IanMagnusson committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6693065 View commit details
    Browse the repository at this point in the history

  3. add tqdms

    @IanMagnusson
    IanMagnusson committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    7486c14 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. bypass gsheet and go back to tokens as cols

    @IanMagnusson
    IanMagnusson committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    00d5f82 View commit details
    Browse the repository at this point in the history

  2. Try with token per row but trim down columns

    @IanMagnusson
    IanMagnusson committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    01fd44b View commit details
    Browse the repository at this point in the history

  3. append rather than list concat

    @IanMagnusson
    IanMagnusson committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    6e91272 View commit details
    Browse the repository at this point in the history

  4. just record revision

    @IanMagnusson
    IanMagnusson committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    18c707a View commit details
    Browse the repository at this point in the history