Stay informed on the Kenyan Constitution
A web and command line application that powered by AI that can answer various questions about the Kenya 2010 consitution.
Three environment variables are needed for LLM access.
LLM_API_KEY: The secret api key from your LLM providerLLM_BASE_URL: The API endpoint to your LLM providerLLM_MODEL_NAME: The name of model you want to use
Any provider that provides an API compatible with OpenAI's Chat Completions API can be used.
The API key can be generated in their respective consoles.
Sample Values are shown below:
| Provider | Base URL | Model Name Example |
|---|---|---|
| Akash Network | https://chatapi.akash.network/api/v1 | Meta-Llama-3-1-405B-Instruct-FP8 |
| Mistral AI | https://api.mistral.ai/v1 | open-mistral-nemo |
| Ollama | http://localhost:11434/v1 | qwen2.5:3b |
The easiest way to run the app is via Docker. Pull it from docker hub:
docker pull programmerke/katiba_chat:latestThe app can then be executed by creating a container with the
variables above. Assuming they are specified in a file
named .env:
docker run --env-file .env programmerke/katiba_chatThe app can now be accessed at: http://localhost:7860
One convenient way to deploy the docker image is through the Akash network.
See detailed instructions here
- GNU AFFERO GENERAL PUBLIC LICENSE