Pinned Loading

1. open-mmlab/mmdeploy open-mmlab/mmdeploy Public

   OpenMMLab Model Deployment Framework

   Python 2.9k 656

2. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 5.9k 508

3. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 22.6k 5.7k

4. ppl.pmx ppl.pmx Public

   Forked from OpenPPL/ppl.pmx

   Python 1

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python