Skip to content

Commit

Permalink
Wording suggestion from Ali
Browse files Browse the repository at this point in the history
Co-authored-by: Ali Maredia <[email protected]>
Signed-off-by: Nathan Weinberg <[email protected]>
  • Loading branch information
nathan-weinberg and alimaredia committed Jun 11, 2024
1 parent 1b40cb0 commit 1133893
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/evaluation/eval-repo.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ closest implementation currently in `instructlab/instructlab` via the `ilab test
a JSON Lines file and a LoRA adapter to compare output of a given model before and after
LoRA training with MLX, thus the macOS M-series dependency.

We desire to build out an implementation closer to the described evaluation in the paper,
using more high-level evaluation schemes such as
We desire tobuild out a library for methods that satisfy the evaluation described in the
paper, using more high-level evaluation schemes such as
[Multi-turn Benchmark](https://arxiv.org/abs/2306.05685) for skills and
[Massive Multitask Language Understanding](https://arxiv.org/abs/2009.03300) (MMLU) for
knowledge. We propose a new repository to house this code that publishes a new Python
Expand Down

0 comments on commit 1133893

Please sign in to comment.