Pinned Loading

1. lite.ai.toolkit lite.ai.toolkit Public

   🛠 A lite C++ toolkit of 100+ awesome AI models, support ONNXRuntime, MNN, NCNN, TNN and TensorRT. 🎉🎉

   C++ 3.7k 700

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 30.9k 4.7k

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📖A curated list of Awesome LLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism etc. 🎉🎉

   2.9k 199

4. CUDA-Learn-Notes CUDA-Learn-Notes Public

   📚Tensor/CUDA Cores, 📖150+ CUDA Kernels, 🔥🔥toy-hgemm library with WMMA, MMA and CuTe(99%~100%+ TFLOPS of cuBLAS 🎉🎉).

   Cuda 1.5k 164

5. statistic-learning-R-note statistic-learning-R-note Public

   📒《统计学习方法-李航: 笔记-从原理到实现，基于R语言》200页PDF，各种手推公式细节讲解，R语言实现. 🎉🎉

   422 55

6. Awesome-Diffusion-Inference Awesome-Diffusion-Inference Public

   📖A curated list of Awesome Diffusion Inference Papers with codes, such as Sampling, Caching, Multi-GPUs etc. 🎉🎉

   100 5