An experimental implementation of LLM matrix operations on a $2 microcontroller with SD card memory offloading.
Full code for running basic LLM operations by implementing matrix multiplication and self-attention calculations on an ATmega328P microcontroller (2KB RAM, 32KB Flash). While running a full LLM is infeasible, the project successfully demonstrates core mathematical operations using SD card memory offloading.
- Basic integer matrix multiplication
- SD card memory offloading for large matrices
- Serial communication for validation
- Quantized 8-bit integer operations
- Implementation of Q,K,V attention calculations
- Test validation kernels
- Arduino implementation code
- SD card memory management
- Matrix multiplication routines
- Serial communication utilities
- ATmega328P microcontroller
- SD card module
- Python (for validation scripts)
MIT