Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Add Custom Model Button for Easier Maintenance #906

Open
jiangyouwang6 opened this issue Sep 12, 2024 · 2 comments
Open

[FEAT] Add Custom Model Button for Easier Maintenance #906

jiangyouwang6 opened this issue Sep 12, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@jiangyouwang6
Copy link

Is your feature request related to a problem? / 你想要的功能和什么问题相关?

大模型经常更新,孙老师维护应该也非常困难,希望能增加一个自定义大模型的按钮在程序中

Describe the solution you'd like. / 你想要的解决方案是什么?

类似于chatnext,自定义模型

Describe alternatives you've considered. / 你考虑过的其他方案是什么?

No response

Additional context / 其他信息

No response

@jiangyouwang6 jiangyouwang6 added the enhancement New feature or request label Sep 12, 2024
@PeterDaveHello PeterDaveHello changed the title [FEAT] [FEAT] Add Custom Model Button for Easier Maintenance Sep 27, 2024
@eddieai
Copy link

eddieai commented Oct 3, 2024

Agree.
Especially since most LLM APIs currently are similar to OpenAI's API. By simply providing a custom model option compatible with the OpenAI API, allowing users to input custom API URL + API key + Model ID, it would support the APIs of most LLMs.

A good reference could be the VS Code extension Claude dev, it includes a feature that allows users to add custom APIs that are compatible with OpenAI:
image

@eddieai
Copy link

eddieai commented Oct 3, 2024

Some OpenAI Compatible API that I've used:

  • DeepSeek
  • Mistral
  • Cohere
  • Groq

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants