This sample demonstrates querying a MySQL database using natural language thanks to LangChain, Chainlit, and Ollama.
Runs locally. No internet.
This project includes the classicmodels sample MySQL database.
- Docker Desktop
- Visual Studio Code + Dev Containers extension
- A dedicated NVIDIA GPU
- Open the repository in Visual Studio Code.
- Use the Dev Containers command
Reopen in a Container
.- Tip: Use
Ctrl
+Shift
+P
to open the command pallete.
- Tip: Use
- Install a LLM in the
llm
container using Ollama.- Command:
ollama pull mistral:7b-instruct-v0.2-q5_K_M
- Command:
- Set the
LLM_MODEL
in the.env
file (If you choose a different model). - When the Dev Container has loaded, launch the app using
F5
.