Pinned Loading

1. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Cuda 1.5k 153

2. apache/tvm apache/tvm Public

   Open deep learning compiler stack for cpu, gpu and specialized accelerators

   Python 11.9k 3.5k

3. mlc-ai/mlc-llm mlc-ai/mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 19.4k 1.6k

4. uwsampl/SparseTIR uwsampl/SparseTIR Public

   SparseTIR: Sparse Tensor Compiler for Deep Learning

   Python 133 14

5. punica-ai/punica punica-ai/punica Public

   Serving multiple LoRA finetuned LLM as one

   Python 1k 46

6. dmlc/dgl dmlc/dgl Public

   Python package built to ease deep learning on graph, on top of existing DL frameworks.

   Python 13.6k 3k