Skip to content

Add spec ops and config expectations to deployment guide#164

Merged
yellowman merged 2 commits intomainfrom
codex/fix-async-await-in-user-listing-and-centroids-2e6fez
Dec 10, 2025
Merged

Add spec ops and config expectations to deployment guide#164
yellowman merged 2 commits intomainfrom
codex/fix-async-await-in-user-listing-and-centroids-2e6fez

Conversation

@yellowman
Copy link
Copy Markdown
Owner

@yellowman yellowman commented Dec 10, 2025

Summary

  • add spec-derived ops, retention, and backup defaults to the deployment guide
  • document configuration management expectations for database-managed knobs versus environment-only secrets

Testing

  • python -m compileall liminallm

Codex Task


Note

Major expansion of DEPLOYMENT.md with zero-to-one checklist, backend lanes (local GPU LoRA and API), ops/safety defaults, and DB-driven config guidance.

  • Docs: docs/DEPLOYMENT.md
    • Scope expansion:
      • Add zero-to-one Linux checklist and clearer prerequisites (GPU/CUDA/ROCm notes, TLS/nginx).
      • Clarify config cheatsheet (local base model path, adapter/API key vars) and writable data dirs.
    • Backend lanes:
      • Local GPU LoRA: setup, paths (/srv/liminallm/models, /srv/liminallm/adapters), JAX GPU wheel guidance, run flags, adapter modes.
      • API backend: provider keys/URLs, base_model handling, scenarios (managed only, hosted+local adapters, prompt-only), provider switching note.
      • Hybrid deployments: mix local and API; filesystem artifacts remain source of truth.
    • Model handling: base models frozen; adapters stored/streamed; training writes adapters only; request parameters (base_model, adapter_id, adapter_mode).
    • Ops & safety defaults: observability/health checks, retention windows, alerting, backup strategy, safety rails.
    • Configuration management: most runtime settings managed in DB via /admin; limit env vars to infra/bootstrap secrets.
    • Operational notes: docker/manual steps, reverse proxy pointers, troubleshooting commands.

Written by Cursor Bugbot for commit fe0de27. This will update automatically on new commits. Configure here.

@yellowman yellowman merged commit 488e165 into main Dec 10, 2025
4 of 5 checks passed
@yellowman yellowman deleted the codex/fix-async-await-in-user-listing-and-centroids-2e6fez branch December 10, 2025 15:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant