Skip to content

Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).

Notifications You must be signed in to change notification settings

techmaxsolucoes/gpt4all-ui

This branch is 2 commits ahead of mkellerman/gpt4all-ui:main.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

1afd3ed · May 23, 2023

History

11 Commits
Apr 7, 2023
Apr 3, 2023
Apr 7, 2023
May 23, 2023
Apr 7, 2023
May 23, 2023
Apr 7, 2023

Repository files navigation

gpt4all-ui

Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).

Screenshot 2023-04-06 at 10 40 40 PM

Clone the repositor (with submodules)

git clone https://github.com/mkellerman/gpt4all-ui.git
cd gpt4all-ui

Copy your Models in the workspace

Models should be copied to models folder in the root of the gpt4all-ui folder.

If you have your models located somewhere else, you can create a alias (link) to your folder.

ln -s /Users/Me/Documents/Models models

Start it up

docker-compose up -d

And open http://localhost:3000

Sources:

chatboi-ui (web): https://github.com/mckaywrigley/chatbot-ui

llama-cpp-python (api): https://github.com/abetlen/llama-cpp-python

About

Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 97.0%
  • Dockerfile 3.0%