Pinned Loading

1. sgl-project/rbg sgl-project/rbg Public

   A workload for deploying LLM inference services on Kubernetes

   Go 167 42

2. kubernetes/cloud-provider-alibaba-cloud kubernetes/cloud-provider-alibaba-cloud Public

   CloudProvider for Alibaba Cloud

   Go 373 161

3. kubernetes-sigs/lws kubernetes-sigs/lws Public

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go 655 127

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 69.2k 13.1k

5. kserve/kserve kserve/kserve Public

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Go 5.1k 1.4k