This repository was archived by the owner on Oct 11, 2024. It is now read-only.
This repository was archived by the owner on Oct 11, 2024. It is now read-only.
API requests supporting local deployment of OpenAI-Compatible Server #96
Description
Currently, there are many LLMs in the open-source community, along with several reasoning frameworks that support server deployment following the OpenAI API protocol (e.g. vLLM, api-for-open-llm, etc). API requests supporting local deployment of servers are quite useful.