Discover, download and run local LLMs locally on your machine with the top AI tools.
- Read our article on Top Local LLM tools.
- Watch the Top Locall LLM Tools video on YouTube.
| LLM Tool | Description |
|---|---|
| LM Studio | Run LLMs on your laptop, entirely offline. |
| Jan | Jan is a ChatGPT-alternative that runs 100% offline on your Desktop |
| Llamafile | Distribute and run LLMs with a single file. |
| GPT4ALL | Run language models on consumer hardware. |
| Ollama | Get up and running with large language models. |
| Llama.cpp | Inference of Meta's LLaMA model (and others) in pure C/C++. |
| BitNet | Official inference framework for 1-bit LLMs. |