Skip to content

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 56.1k 9.6k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 1.8k 213

  3. recipes recipes Public

    Common recipes to run vLLM

    110 25

Repositories

Showing 10 of 21 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 56,100 Apache-2.0 9,593 1,812 (17 issues need help) 999 Updated Aug 23, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,026 Apache-2.0 361 334 (5 issues need help) 142 Updated Aug 23, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 1,830 Apache-2.0 213 49 (7 issues need help) 34 Updated Aug 23, 2025
  • vllm-project/vllm-project.github.io’s past year of commit activity
    HTML 14 20 0 0 Updated Aug 23, 2025
  • flash-attention Public Forked from Dao-AILab/flash-attention

    Fast and memory-efficient exact attention

    vllm-project/flash-attention’s past year of commit activity
    Python 88 BSD-3-Clause 1,926 0 13 Updated Aug 23, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 32 Apache-2.0 21 7 14 Updated Aug 22, 2025
  • production-stack Public

    vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

    vllm-project/production-stack’s past year of commit activity
    Python 1,704 Apache-2.0 263 69 (3 issues need help) 44 Updated Aug 22, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 15 32 0 7 Updated Aug 22, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 8 26 1 21 Updated Aug 22, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,082 Apache-2.0 432 214 (22 issues need help) 16 Updated Aug 22, 2025