Pinned Loading

1. mit-han-lab/qserve mit-han-lab/qserve Public

   QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

   Python 469 28

2. mit-han-lab/llm-awq mit-han-lab/llm-awq Public

   [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python 2.6k 216

3. mit-han-lab/torchsparse mit-han-lab/torchsparse Public

   [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

   Cuda 1.2k 142

4. mit-han-lab/deepcompressor mit-han-lab/deepcompressor Public

   Model Compression Toolbox for Large Language Models and Diffusion Models

   Python 280 22

5. ys-2020.github.io ys-2020.github.io Public

   CSS