Skip to content

Commit

Permalink
note on using the main scorer for max_attempts
Browse files Browse the repository at this point in the history
  • Loading branch information
jjallaire committed Sep 10, 2024
1 parent 49eba00 commit 8806522
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions docs/agents.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,9 @@ There are several options available for customising the behaviour of the basic a

: {tbl-colwidths=\[23,20,50\]}

For multiple attempts, submissions are evaluated using the task's main scorer, with value of 1.0 indicating a correct answer. Scorer values are converted to float (e.g. "C" becomes 1.0) using the standard `value_to_float()` function. Provide an alternate conversion scheme as required via `score_value`.


## Custom Scaffold {#sec-custom-scaffolding}

The basic agent demonstrated above will work well for some tasks, but in other cases you may need to provide more custom logic. For example, you might want to:
Expand Down

0 comments on commit 8806522

Please sign in to comment.