Pinned Loading

1. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from DefTruth/Awesome-LLM-Inference

   📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

2. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   LLM inference in C/C++

   C++

3. whisper.cpp whisper.cpp Public

   Forked from ggerganov/whisper.cpp

   Port of OpenAI's Whisper model in C/C++

   C++

4. ggml ggml Public

   Forked from ggml-org/ggml

   Tensor library for machine learning

   C++