Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

求助,有3个关于Langchain-Chatchat配置模型的疑问 #4360

Open
BaoxingZhang opened this issue Jun 28, 2024 · 0 comments
Open

求助,有3个关于Langchain-Chatchat配置模型的疑问 #4360

BaoxingZhang opened this issue Jun 28, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@BaoxingZhang
Copy link

1、pip install langchain-chatchat -U 这种形式安装的,在这个yaml中/lib/python3.10/site-packages/chatchat/configs/model_providers.yaml有如下配置:

image

2、在模型启动前,需要执行以下设置:

chatchat-config model --set_model_platforms "[{
    \"platform_name\": \"xinference\",
    \"platform_type\": \"xinference\",
    \"api_base_url\": \"http://127.0.0.1:9997/v1\",
    \"api_key\": \"EMPT\",
    \"api_concurrencies\": 5,
    \"llm_models\": [
        \"chatglm3\"
    ],
    \"embed_models\": [
        \"bge-large-zh-v1.5\"
    ],
    \"image_models\": [],
    \"reranking_models\": [],
    \"speech2text_models\": [],
    \"tts_models\": []
}]"

3、还有一个设置默认模型的地方:

chatchat-config model --default_llm_model chatglm3

而对应到Xinference之后会有模型ID、模型Name,当在Xinferenec上面注册模型的时候ID和Name可以不一致,这样的话对应关系稍微有些分不清楚,以及优先级。是否需要全部检查一遍,全部设置好之后再启动 Langchain-Chatchat

@BaoxingZhang BaoxingZhang added the enhancement New feature or request label Jun 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant