Popular repositories Loading

1. pytorch pytorch Public

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python

2. ml-mobileclip ml-mobileclip Public

   Forked from apple/ml-mobileclip

   This repository contains the official implementation of the research paper, "MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training" CVPR 2024

   Python

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. LCKV LCKV Public

   Forked from whyNLP/LCKV

   Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

   Python

6. MInference MInference Public

   Forked from microsoft/MInference

   [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an …

   Python