letmequeue

Here is 1 public repository matching this topic...

gszecsenyi / LLMeQueue

A distributed queue system for LLM tasks. Submit requests via OpenAI-compatible REST API from anywhere, process with Ollama on your local GPU (NVIDIA or Apple Silicon), and retrieve results. FastAPI server + SQLite queue + GPU worker architecture.

distributed-systems embeddings task-queue openai-api llm ollama letmequeue

Updated Jan 4, 2026
Python

Improve this page

Add a description, image, and links to the letmequeue topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the letmequeue topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

letmequeue

Here is 1 public repository matching this topic...

gszecsenyi / LLMeQueue

Improve this page

Add this topic to your repo