Skip to content

Commit

Permalink
raise prompt param settings for CUDA change-002
Browse files Browse the repository at this point in the history
  • Loading branch information
Ifiht committed Apr 26, 2024
1 parent a5f4afc commit 0d6e690
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/modules/discord/discord.rb
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,8 @@ def format_question(prompt)
"repeat_last_n" => 128, # Last n tokens to consider for penalizing repetition. 0 is disabled and -1 is ctx-size.
"repeat_penalty" => 1.1, # Control the repetition of token sequences in the generated text.
"top_k" => 32, # def:40, Limit the next token selection to the K most probable tokens.
"top_p" => 0.8, # def:0.95, higher finds better predictions, but slower
"min_p" => 0.07, # def:0.05, The minimum probability for a token to be considered, relative to the probability of the most likely token.
"top_p" => 0.9, # def:0.95, higher finds better predictions, but slower
"min_p" => 0.06, # def:0.05, The minimum probability for a token to be considered, relative to the probability of the most likely token.
"tfs_z" => 1, # def:1(disabled) https://www.trentonbricken.com/Tail-Free-Sampling/
"typical_p" => 1, # def:1(disabled)
"presence_penalty" => 0, # def:0(disabled)
Expand Down

0 comments on commit 0d6e690

Please sign in to comment.