Skip to content

Commit

Permalink
Add OpenAI request timeout (#858)
Browse files Browse the repository at this point in the history
* Adds the timeout kwarg for the OpenAI LLM

* Don't overwrite the client level timeout

* Update version

---------

Co-authored-by: Agus <[email protected]>
Co-authored-by: plaguss <[email protected]>
  • Loading branch information
3 people authored Aug 7, 2024
1 parent 1b43450 commit 268358b
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/distilabel/llms/openai.py
Original file line number Diff line number Diff line change
Expand Up @@ -247,7 +247,6 @@ async def agenerate( # type: ignore
"temperature": temperature,
"top_p": top_p,
"stop": stop,
"timeout": 50,
}

if response_format is not None:
Expand Down

0 comments on commit 268358b

Please sign in to comment.