Skip to content

Commit

Permalink
Add frequency penalty sampling in test
Browse files Browse the repository at this point in the history
  • Loading branch information
dtiarks authored and rlouf committed Feb 10, 2024
1 parent 422a9e9 commit b31d731
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion tests/generate/test_integration_llamacpp.py
Original file line number Diff line number Diff line change
Expand Up @@ -287,7 +287,9 @@ class User(BaseModel):
value: List[float]

result = generate.json(model, User)(
prompt, max_tokens=500, kw_args={"temperature": 0.0, "seed": 0}
prompt,
max_tokens=500,
kw_args={"temperature": 0.0, "seed": 0, "frequency_penalty": 0.5},
)
assert isinstance(result, BaseModel)
assert isinstance(result.id, int)
Expand Down

0 comments on commit b31d731

Please sign in to comment.