Skip to content

Are we able now to specify model temperature for transformers and AWQ models? #509

Answered by rlouf
aalyousfi asked this question in Q&A
Discussion options

You must be logged in to vote

As maintainers we have limited time to triage issues, reply, review PRs, implement new features and prioritise requests. Adding temperature, top-p and top-k are in our backlog of features to implement but currently not the highest priority feature. Please bear with us while we work through the list. PRs are always welcome and we make it a priority to review them quickly.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@aalyousfi
Comment options

Answer selected by aalyousfi
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants