Pinned Loading

1. mit-han-lab/omniserve mit-han-lab/omniserve Public

   [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

   C++ 852 66

2. mit-han-lab/llm-awq mit-han-lab/llm-awq Public

   [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python 3.6k 316

3. mit-han-lab/torchsparse mit-han-lab/torchsparse Public

   [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

   Cuda 1.5k 191

4. ys-2020.github.io ys-2020.github.io Public

   CSS