Skip to content

Conversation

@enyst
Copy link
Collaborator

@enyst enyst commented Dec 29, 2025

Implements runtime LLM switching end-to-end for remote clients (VS Code extension) without agent immutability/diff enforcement.

Key changes:

  • Agent is componentized: restore-time + runtime swaps (LLM, tools, context) are allowed; no diff-based enforcement.
  • Conversation persistence remains durable (base_state + events); LLM selection persists across restart; runtime secrets override persisted secrets on restore.
  • Agent-server REST: POST /api/conversations/{id}/llm (profile_id or inline llm) and POST /api/conversations/{id}/llm/switch.
  • Tests: agent-server wsproto integration covers large event history + restore + runtime LLM switching.

Docs: docs/llm_switching.md
Example: examples/02_remote_agent_server/07_llm_switch_and_restore.py

Docs: check-examples uses matching OpenHands/docs branches; docs PR OpenHands/docs#219 is optional follow-up for landing docs on main.
Beads: agent-sdk-j2s

@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from e6574f6 to a7a9326 Compare December 29, 2025 22:41
@enyst enyst force-pushed the llm-server-switch branch from f5d6265 to d49bf26 Compare December 29, 2025 22:43
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from a7a9326 to 90d0456 Compare December 29, 2025 22:45
@enyst enyst force-pushed the llm-server-switch branch 2 times, most recently from 7b3f8f0 to ff31fd7 Compare December 29, 2025 23:11
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from bec3c43 to fe9f0c7 Compare December 29, 2025 23:40
@enyst enyst force-pushed the llm-server-switch branch from 9e0ef19 to 89ea3d7 Compare December 29, 2025 23:40
@enyst
Copy link
Collaborator Author

enyst commented Dec 29, 2025

Rebased onto updated agent-sdk-26-llm-switch (which now includes latest upstream/main via profile branch). Only remaining failing check is check-examples, pending OpenHands/docs#219.

@enyst enyst force-pushed the llm-server-switch branch from 31ea0dd to b6e47cc Compare December 30, 2025 00:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant