Skip to content

Commit

Permalink
Revert da4edc5
Browse files Browse the repository at this point in the history
  • Loading branch information
nsarrazin committed Dec 26, 2023
1 parent e5cb7bb commit e656737
Showing 1 changed file with 13 additions and 12 deletions.
25 changes: 13 additions & 12 deletions .env.template
Original file line number Diff line number Diff line change
Expand Up @@ -213,18 +213,19 @@ MODELS=`[

OLD_MODELS=`[{"name":"bigcode/starcoder"}, {"name":"OpenAssistant/oasst-sft-6-llama-30b-xor"}, {"name":"HuggingFaceH4/zephyr-7b-alpha"}]`

TASK_MODEL=`{
"name": "mistralai/Mistral-7B-Instruct-v0.2",
"chatPromptTemplate" : "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}}{{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s>{{/ifAssistant}}{{/each}}",
"parameters": {
"temperature": 0.1,
"top_p": 0.95,
"repetition_penalty": 1.2,
"top_k": 50,
"truncate": 3072,
"max_new_tokens": 1024,
"stop": ["</s>"]
}}`
TASK_MODEL='mistralai/Mistral-7B-Instruct-v0.2'
# TASK_MODEL=`{
# "name": "mistralai/Mistral-7B-Instruct-v0.2",
# "chatPromptTemplate" : "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}}{{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s>{{/ifAssistant}}{{/each}}",
# "parameters": {
# "temperature": 0.1,
# "top_p": 0.95,
# "repetition_penalty": 1.2,
# "top_k": 50,
# "truncate": 3072,
# "max_new_tokens": 1024,
# "stop": ["</s>"]
# }}`


APP_BASE="/chat"
Expand Down

2 comments on commit e656737

@gururise
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why was this reverted? was there an issue?

@nsarrazin
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure why, it worked fine locally but wouldn't work in production. @gururise

Please sign in to comment.