Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Load all models from endpoint #4481

Open
Maralai opened this issue Jun 30, 2024 · 0 comments
Open

[Feature]: Load all models from endpoint #4481

Maralai opened this issue Jun 30, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Maralai
Copy link

Maralai commented Jun 30, 2024

The Feature

Consider adding a boolean to the new model dialog with "Load all Models" with the help text of "If this field is toggled, we will call the API to retrieve all models from the endpoint; you can edit the model names, inactivate unwanted models, in the edit dialog." When retrieving all the models, you should check for ones already loaded by that endpoint, only adding new ones. To prevent the retrieval of models from the API that are not wanted, you should introduce a new field in the model's table/editor to disable or deactivate them rather than remove them.

image

This would need to be coupled with the feature outlined here:
#4466

Motivation, pitch

This feature would allow the retrieval of all models available at the endpoints, leveraging the APIs of each provider. If you have added a few models to Ollama, you could grab them all quickly and then edit/inactivate/rename them after retrieving them. It there a new model from Openai? But you forgot the technical name? Just get all, then manage them in your interface.

Twitter / LinkedIn details

No response

@Maralai Maralai added the enhancement New feature or request label Jun 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant