Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 7.3k 697

2. Tencent/Tencent-Hunyuan-Large Tencent/Tencent-Hunyuan-Large Public

   Python 1.4k 70

3. zhihu/ZhiLight zhihu/ZhiLight Public

   A highly optimized LLM inference acceleration engine for Llama and its variants.

   C++ 785 98

4. xgrammar xgrammar Public

   Forked from mlc-ai/xgrammar

   Efficient, Flexible and Portable Structured Generation

   C++

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. OmniBench OmniBench Public

   Forked from multimodal-art-projection/OmniBench

   A project for tri-modal LLM benchmarking and instruction tuning.

   Python