Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. semantic-router semantic-router Public

   Forked from vllm-project/semantic-router

   Intelligent Router for Mixture-of-Models

   Go

3. slime slime Public

   Forked from THUDM/slime

   slime is an LLM post-training framework for RL Scaling.

   Python

4. sglang-ant sglang-ant Public

   Forked from antgroup/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

5. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 22.7k 4.2k

6. miles miles Public

   Forked from radixark/miles

   Python