We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
1、pip install langchain-chatchat -U 这种形式安装的,在这个yaml中/lib/python3.10/site-packages/chatchat/configs/model_providers.yaml有如下配置:
pip install langchain-chatchat -U
/lib/python3.10/site-packages/chatchat/configs/model_providers.yaml
2、在模型启动前,需要执行以下设置:
chatchat-config model --set_model_platforms "[{ \"platform_name\": \"xinference\", \"platform_type\": \"xinference\", \"api_base_url\": \"http://127.0.0.1:9997/v1\", \"api_key\": \"EMPT\", \"api_concurrencies\": 5, \"llm_models\": [ \"chatglm3\" ], \"embed_models\": [ \"bge-large-zh-v1.5\" ], \"image_models\": [], \"reranking_models\": [], \"speech2text_models\": [], \"tts_models\": [] }]"
3、还有一个设置默认模型的地方:
chatchat-config model --default_llm_model chatglm3
而对应到Xinference之后会有模型ID、模型Name,当在Xinferenec上面注册模型的时候ID和Name可以不一致,这样的话对应关系稍微有些分不清楚,以及优先级。是否需要全部检查一遍,全部设置好之后再启动 Langchain-Chatchat
The text was updated successfully, but these errors were encountered:
No branches or pull requests
1、
pip install langchain-chatchat -U
这种形式安装的,在这个yaml中/lib/python3.10/site-packages/chatchat/configs/model_providers.yaml
有如下配置:2、在模型启动前,需要执行以下设置:
3、还有一个设置默认模型的地方:
而对应到Xinference之后会有模型ID、模型Name,当在Xinferenec上面注册模型的时候ID和Name可以不一致,这样的话对应关系稍微有些分不清楚,以及优先级。是否需要全部检查一遍,全部设置好之后再启动 Langchain-Chatchat
The text was updated successfully, but these errors were encountered: