Pinned Loading

1. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   LLM inference in C/C++

   C++

2. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from DefTruth/Awesome-LLM-Inference

   📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

3. LLMs-from-scratch LLMs-from-scratch Public

   Forked from rasbt/LLMs-from-scratch

   Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

   Jupyter Notebook

4. cuda_practices cuda_practices Public

   Cuda

5. triton_practices triton_practices Public

   Python

6. build_llm_from_scratch build_llm_from_scratch Public