Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add parallel processing for OpenAI completion models #1460

Closed
wants to merge 4 commits into from
+604 −54
Closed

Add parallel processing for OpenAI completion models #1460

Changes from 1 commit
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
e1ae306
Add parallel processing for openai completion models
pbevan1 Feb 22, 2024
d687e34
Minor fix to print statement
pbevan1 Feb 22, 2024
73dd96e
Add ability to set max_attempts in kwargs
pbevan1 Feb 22, 2024
0550178
Add *0.75 to rate limits for headroom
pbevan1 Feb 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Minor fix to print statement
@pbevan1
pbevan1 committed Feb 22, 2024
commit d687e34e5a8a1ca959610b5e799061161a6c20fe
4 changes: 1 addition & 3 deletions lm_eval/models/openai_completions.py
View file
Original file line number Diff line number Diff line change
@@ -960,9 +960,7 @@ def clean_up_requests(signum=None, frame=None):

print(f"Requests written to {requests_file_path}.")

print(
f"Max requests per minute: {max_requests_per_minute}, use --gen_kwargs max_requests_per_minute=N to override"
)
print(f"Max requests per minute: {max_requests_per_minute}")
print(f"Max tokens per minute: {max_tokens_per_minute}")
print(
"use --gen_kwargs max_requests_per_minute=N,max_tokens_per_minute=N to override"