From 8806522e94c5f8c73fc3a943d8974d978e9f6dec Mon Sep 17 00:00:00 2001 From: "J.J. Allaire" Date: Mon, 9 Sep 2024 21:17:54 -0400 Subject: [PATCH] note on using the main scorer for max_attempts --- docs/agents.qmd | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/agents.qmd b/docs/agents.qmd index 666cd9f46..dd9cb7453 100644 --- a/docs/agents.qmd +++ b/docs/agents.qmd @@ -98,6 +98,9 @@ There are several options available for customising the behaviour of the basic a : {tbl-colwidths=\[23,20,50\]} +For multiple attempts, submissions are evaluated using the task's main scorer, with value of 1.0 indicating a correct answer. Scorer values are converted to float (e.g. "C" becomes 1.0) using the standard `value_to_float()` function. Provide an alternate conversion scheme as required via `score_value`. + + ## Custom Scaffold {#sec-custom-scaffolding} The basic agent demonstrated above will work well for some tasks, but in other cases you may need to provide more custom logic. For example, you might want to: