Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.2k 4.7k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 72.6k 14.1k

3. unslothai/unsloth unslothai/unsloth Public

   Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

   Python 53.6k 4.5k

4. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 41.8k 4.7k

5. apache/tvm apache/tvm Public

   Open Machine Learning Compiler Framework

   Python 13.2k 3.8k

6. huggingface/optimum-habana huggingface/optimum-habana Public

   Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

   Python 207 270