A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

llama.go is like llama.cpp in pure Golang!

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Create characters in Unity with LLMs!

Self-evaluating interview for AI coders

Run AI ✨ assistant locally! with simple API for Node.js 🚀

React Native binding of llama.cpp

LLama.cpp rust bindings

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

Local ML voice chat using high-end models.

Run LLMs locally. A clojure wrapper for llama.cpp.

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg

Making offline AI models accessible to all types of edge devices.

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

Langport is a language model inference service

InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.