Skip to content

feat: chat api#2

Merged
jclab-joseph merged 7 commits intomasterfrom
feat/chat-api
Jun 12, 2025
Merged

feat: chat api#2
jclab-joseph merged 7 commits intomasterfrom
feat/chat-api

Conversation

@jclab-joseph
Copy link
Contributor

@jclab-joseph jclab-joseph commented Jun 12, 2025

OpenAI compatible API Endpoints.

config example:

server:
  api:
    port: 9801
    openai:
      enabled: true
      chat_completions_queue: "example/chat"
      completions_queue: "example/completions"
      embeddings_queue: "example/embeddings"

worker example: https://github.com/jc-lab/distworker/blob/d02779349d87d8f92777b30fa1988fe232cf0a1d/python/examples/modal-worker.py

@jclab-joseph jclab-joseph merged commit f7fd20d into master Jun 12, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant