yyihuang

Follow

☝️

Greetings.

eigen yyihuang

☝️

Greetings.

Follow

GPU architect

97 followers · 35 following

NVIDIA
Pittsburgh
07:42 (UTC -05:00)
https://www.linkedin.com/in/avyh/

Achievements

Achievements

yyihuang/README.md

Hi there 👋

I am working on LLM inference kernel. Free to reach out! https://www.linkedin.com/in/avyh/

Pinned Loading

flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

FlashInfer: Kernel Library for LLM Serving

Python 4.8k 680
flashinfer-ai/flashinfer-bench flashinfer-ai/flashinfer-bench Public

Building the Virtuous Cycle for AI-driven LLM Systems

Python 145 21
sgl-project/sglang sgl-project/sglang Public

SGLang is a high-performance serving framework for large language models and multimodal models.

Python 23k 4.3k
sgl-project/SpecForge sgl-project/SpecForge Public

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Python 668 151
mirage-project/mirage mirage-project/mirage Public

Mirage Persistent Kernel: Compiling LLMs into a MegaKernel

C++ 2.1k 170