Pinned Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

3. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   Python