Popular repositories Loading

1. FastVideo FastVideo Public

   FastVideo is a lightweight framework for accelerating large video diffusion models.

   Python 1.3k 78

2. LookaheadDecoding LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.2k 74

3. Consistency_LLM Consistency_LLM Public

   [ICML 2024] CLLMs: Consistency Large Language Models

   Python 391 17

4. Dynasor Dynasor Public

   Simple extension on vLLM to help you speed up reasoning model without training.

   Python 146 23

5. MuxServe MuxServe Public

   Jupyter Notebook 59 4

6. vllm-ltr vllm-ltr Public

   [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

   Python 46 11