Skip to content

Commit

Permalink
Merge pull request #829 from dastrobu/docs/chat-model-config
Browse files Browse the repository at this point in the history
fix docs on topP
  • Loading branch information
geoand authored Aug 27, 2024
2 parents 10d9382 + 2047a05 commit 779b4fe
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ public interface ChatModelConfig {
* An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens
* with topP probability mass.
* 0.1 means only the tokens comprising the top 10% probability mass are considered.
* It is recommended to alter this or topP, but not both.
* It is recommended to alter this or temperature, but not both.
*/
@WithDefault("1.0")
Double topP();
Expand Down

0 comments on commit 779b4fe

Please sign in to comment.