Skip to content
Change the repository type filter

All

    Repositories list

    • Mooncake

      Public
      Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
      C++
      Apache License 2.0
      1282.3k101Updated Dec 23, 2024Dec 23, 2024
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      4.9k600Updated Dec 21, 2024Dec 21, 2024
    • FlashInfer: Kernel Library for LLM Serving
      Cuda
      Apache License 2.0
      161000Updated Dec 17, 2024Dec 17, 2024
    • A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
      Python
      Apache License 2.0
      41774230Updated Nov 14, 2024Nov 14, 2024