Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 87.8k 20.1k

2. Lightning-AI/litData Lightning-AI/litData Public

   Speed up model training by fixing data loading.

   Python 606 102

3. ray-project/ray ray-project/ray Public

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python 43.4k 7.9k

4. kserve/kserve kserve/kserve Public

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Go 5.8k 1.6k