Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ollama做api后端 #1992

Open
1 task done
MRQJsfhf opened this issue May 16, 2024 · 8 comments
Open
1 task done

ollama做api后端 #1992

MRQJsfhf opened this issue May 16, 2024 · 8 comments
Labels
enhancement New feature or request

Comments

@MRQJsfhf
Copy link

⚠️ 搜索是否存在类似issue

  • 我已经搜索过issues和disscussions,没有发现相似issue

总结

不支持ollama等本地大模型做后端吗?

举例

No response

动机

No response

@phonezhou
Copy link

对的,我看见支持qwen,但还是不能调用本地的,自动转向外网!

[ERROR][2024-05-18 17:47:28][chat_channel.py:303] - Worker return exception: Error: MissingAccessKeyId code: 400, AccessKeyId is mandatory for this action. request id: E5D277B2-AFB0-5EB5-9FA5-027572678F8A Response: {'RequestId': 'E5D277B2-AFB0-5EB5-9FA5-027572678F8A', 'Message': 'AccessKeyId is mandatory for this action.', 'Recommend': 'https://api.aliyun.com/troubleshoot?q=MissingAccessKeyId&product=bailian&requestId=E5D277B2-AFB0-5EB5-9FA5-027572678F8A', 'HostId': 'bailian.cn-beijing.aliyuncs.com', 'Code': 'MissingAccessKeyId', 'statusCode': 400}

@6vision
Copy link
Collaborator

6vision commented May 19, 2024

有一个pr试试呢,看看是否可行 #1932

@taozhiyuai
Copy link

有一个pr试试呢,看看是否可行 #1932

我正在用呢

@taozhiyuai
Copy link

@6vision 合并这个PR呀

@6vision
Copy link
Collaborator

6vision commented May 22, 2024

@6vision 合并这个PR呀

可以正常使用,对吧,有什么问题没

@taozhiyuai
Copy link

@6vision 合并这个PR呀

可以正常使用,对吧,有什么问题没

没问题

@6vision 6vision added enhancement New feature or request and removed status: needs check labels May 22, 2024
@Zctoylm0927
Copy link

我在本地合并了这个pr,目前使用暂时只发现设定的character_desc无法起到作用,其余功能正常

@leedaga
Copy link

leedaga commented Aug 23, 2024

如何配置呢? 谁发个config.json 看看

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

6 participants