Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Homogeneize generation params #428

Merged
merged 44 commits into from
Jan 2, 2025
Merged
Changes from 1 commit
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
1ff5a78
adding input generation config
clefourrier Dec 9, 2024
12c6a90
added tgi model
clefourrier Dec 9, 2024
c9657d2
grammar is task dependant, removed from the cofnig
clefourrier Dec 9, 2024
ac6565a
added openai config + moved everything to dict
clefourrier Dec 9, 2024
2628571
added generation configs to models
clefourrier Dec 9, 2024
c24bf9b
added generation configs to models
clefourrier Dec 9, 2024
0aa2e19
fix
clefourrier Dec 9, 2024
e3311bd
fix
clefourrier Dec 9, 2024
a3f535f
added doc
clefourrier Dec 9, 2024
286668f
Saved GenerationParameter class in model config classes, then saved i…
clefourrier Dec 10, 2024
0b2475a
changed model args
clefourrier Dec 10, 2024
521559f
test
clefourrier Dec 10, 2024
91363fe
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 11, 2024
c088ab6
updated launchers
clefourrier Dec 11, 2024
e1bd34f
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 12, 2024
3eb7d0f
rename base_model to transformers_model
clefourrier Dec 12, 2024
a585701
removed the use of a GenerationConfig object, as it's got lots of par…
clefourrier Dec 12, 2024
f9ab29b
revert
clefourrier Dec 12, 2024
4833929
fix docs
clefourrier Dec 12, 2024
30bed89
fix #16 by also allowing a generationconfig object to be passed progr…
clefourrier Dec 12, 2024
431b4f2
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 12, 2024
fb4ecdc
Apply suggestions from code review
clefourrier Dec 16, 2024
be99c5e
Update src/lighteval/models/transformers/transformers_model.py
clefourrier Dec 16, 2024
e8b9057
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 16, 2024
dece2f9
removed temperature from default vllm params as it should be passed v…
clefourrier Dec 17, 2024
8e3b7e2
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 17, 2024
5c89fe2
Update src/lighteval/models/transformers/transformers_model.py
clefourrier Dec 18, 2024
6a18b81
logging fix
clefourrier Dec 18, 2024
83cbb10
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 18, 2024
c6f42ca
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 18, 2024
90593a9
added default gen params
clefourrier Dec 18, 2024
ff5026b
Apply suggestions from code review
clefourrier Dec 26, 2024
87d052c
rename file
clefourrier Dec 26, 2024
3f96b95
added from path to openai model
clefourrier Dec 26, 2024
843b572
style
clefourrier Dec 26, 2024
e233190
Update src/lighteval/models/transformers/transformers_model.py
clefourrier Dec 26, 2024
97db620
inferenceendpoint renamed to ie
clefourrier Dec 26, 2024
e2d512b
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Dec 26, 2024
e636f73
style 2
clefourrier Dec 26, 2024
ded4cf0
fix vllm
clefourrier Dec 26, 2024
fddfa6f
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Jan 2, 2025
c0566ee
Merge branch 'main' into clem_homogeneize_generation_params
NathanHB Jan 2, 2025
7a54afa
restore line
clefourrier Jan 2, 2025
4319230
Merge branch 'main' into clem_homogeneize_generation_params
clefourrier Jan 2, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
rename file
clefourrier committed Dec 26, 2024
commit 87d052cea03fa8203ff0b0fbcd93b7482d35c2e2
File renamed without changes.