Popular repositories Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 31 16

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 14 5

3. dynamo dynamo Public

   Forked from ai-dynamo/dynamo

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 5 4

4. LMCache LMCache Public

   Forked from LMCache/LMCache

   Making Long-Context LLM Inference 10x Faster and 10x Cheaper

   Python 3

5. demo-agent demo-agent Public archive

   Forked from SWE-agent/SWE-agent

   SWE-agent: Agent Computer Interfaces Enable Software Engineering Language Models

   Python 2 1

6. xDiT xDiT Public

   Forked from xdit-project/xDiT

   xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

   Python 2 3