Skip to content

Commit

Permalink
update comment to not reference eval_gather
Browse files Browse the repository at this point in the history
  • Loading branch information
aisi-inspect committed Aug 19, 2024
1 parent 0d9f9c8 commit 7c0ffba
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions src/inspect_ai/_eval/eval.py
Original file line number Diff line number Diff line change
Expand Up @@ -199,12 +199,11 @@ async def eval_async(
List of EvalLog (one for each task)
"""
# only a single call to eval_async can be active at a time, this is
# because when running a task a chdir to the task's directory (and a
# because when running a task a chdir to the task's directory (and
# similar mutation of the Python sys.path) occurs. since this is a
# change to global process state it cannot occur in parallel. for
# task parallelism, use eval_gather, which enforces the appropriate
# constraints on task parallelism and schedules multiple tasks for
# optimal concurrency
# task parallelism, pass multiple tasks to eval or eval_async (which
# will enforce the appropriate constraints on task parallelism)
global _eval_async_running
if _eval_async_running:
raise RuntimeError("Multiple concurrent calls to eval_async are not allowed.")
Expand Down

0 comments on commit 7c0ffba

Please sign in to comment.