Here are
78 public repositories
matching this topic...
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models. Supports Transformers, AWQ, GPTQ, llama.cpp (GGUF), Llama models
Updated
Jul 2, 2024
Python
a very basic example to start working with LLM using llama and Mistral 7B, or to use as it as a local assistant
Updated
Jul 2, 2024
Python
PowerShell automation to download large language models (LLMs) from Git repositories and quantize them with llama.cpp into the GGUF format.
Updated
Jul 2, 2024
PowerShell
Self-evaluating interview for AI coders
Updated
Jul 1, 2024
Python
Langport is a language model inference service
Updated
Jul 1, 2024
Python
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
Updated
Jun 30, 2024
TypeScript
A custom framework for easy use of LLMs, VLMs, etc. supporting various modes and settings via web-ui
Updated
Jul 1, 2024
Jupyter Notebook
Create characters in Unity with LLMs!
Booster - open platform for serving LLM models
PowerShell automation to rebuild llama.cpp for a Windows environment.
Updated
Jun 27, 2024
PowerShell
Updated
Jun 27, 2024
Rust
Local ML voice chat using high-end models.
Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.
Updated
Jun 24, 2024
JavaScript
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Updated
Jun 21, 2024
TypeScript
a flutter llama.cpp chat ui
Updated
Jun 19, 2024
Metal
llama.cpp gguf file parser for javascript
Updated
Jun 18, 2024
JavaScript
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
Improve this page
Add a description, image, and links to the
llama-cpp
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
llama-cpp
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.