Pinned Loading

1. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 5.7k 759

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 22.1k 3.9k

3. forky forky Public

   A git-style way of managing LLM chats

   Python 15 4

4. srt-slurm srt-slurm Public

   Benchmark SGLang on SLURM

   Python 10 7