Skip to content

Offline LLM support

Pre-release
Pre-release
Compare
Choose a tag to compare
@Adiii1436 Adiii1436 released this 26 Mar 08:34
· 4 commits to main since this release
v0.0.2
0b30a6b
  1. Feature: Added support for running LLMs locally on your system.
    • Download mistral-7b-openorca.gguf2.Q4_0.gguf from the GPT4All website.
    • Place model inside models/https://gpt4all.io/index.html.
    • Now see the magic🌠
Assets 2
Loading