webui: install wizard/model gallery installer

[mudler]

Would be super-awesome to have a small wizard, that might be disabled by default along - to setup an instance by installing few models from the gallery. Ideally would be cool to have as well a "lite" management UX for the gallery too.

It does not have to be necessary part of LocalAI, however, there should be an easy way to install models directly from the browser and/or CLI

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

To install models from the gallery, you can use the following command in the terminal:

localai install model_name --gallery

Replace model_name with the name of the model you want to install. This will download and configure the model in the models directory. You can also use the localai config command to view the list of models that are available in the gallery.
As for the wizard, we are working on a new UI that will make it easier to install and manage models. It will be released soon. In the meantime, you can use the CLI commands to install and manage models.
Regarding the "lite" management UX for the gallery, we are also planning to add a dashboard in the UI where you can view the list of models and their details, as well as download and install them directly from the browser. This will be released soon as well.

Sources:

• https://localai.io/model-compatibility/llama-cpp/index.html
• https://localai.io/models/index.html
• https://localai.io/howtos/easy-model-import-gallery/index.html

[Jirubizu]

I am currently working on a project that will allow users to just potentially run a webui along side their api which will expose an admin panel to install new models and view job states. Development is one in the following repo, but I would like to note this is still a heavily WIP project

https://github.com/Jirubizu/localai-admin

[mudler]

this is done now. We have a follow-up card to track enhancements #2156