Popular repositories Loading

1. ScaleLLM ScaleLLM Public

   Forked from vectorch-ai/ScaleLLM

   A high-performance inference system for large language models, designed for production environments.

   C++

2. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

3. custom_op custom_op Public

   this is my cuda kernel room

   Cuda

4. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

5. vllm-091 vllm-091 Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python