LLM Recipes

• Assistant
  • On-device assistant with Speech, Vision, Text search

Discord Server

Version	Concept	Status	Tech
v0.8	Quantisation	In progress	llama.cpp
v0.7	On-device Mobile	In progress	Android + TF lite
v0.6	UI	In progress	Typescript
v0.5	Indoor Maps + v0.4	In progress	ROS2
v0.4	Image/Scene Recognition + v0.3	complete	llava/moondream
v0.3	Speech output + v0.2	Complete	coqui tts + v1
v0.2	Speech input + v0.1	Complete	whisper + ffpmeg + v0
v0.1	Text Query + API calls	Complete	mistral7B-v0.3 + ollama + RestAPI

• Base Setup

  • ChatUI : ollama + open-webui + mistral-7B + docker
    • Setup + Documentation at ollama-open-webui.md
  • Code CoPilot : vscode + continue + ollama + mistral-7B
    • Setup document at code-pair.md

• Tutorials

• Extra

  • Clean install of ubuntu + docker + nvidia requirements

• Applications

  • Reconnaisance with Drone
  • Use Drones to create real-time insights of Warehouse, Home securiy

• Upcoming Challenges
  • Hackathons