Skip to content

Switch to LiteLLM Responses API; default gpt-5 and --fast gpt-5-nano with high reasoning#3

Open
devin-ai-integration[bot] wants to merge 3 commits intomainfrom
devin/1757769949-switch-to-litellm-responses-gpt5
Open

Switch to LiteLLM Responses API; default gpt-5 and --fast gpt-5-nano with high reasoning#3
devin-ai-integration[bot] wants to merge 3 commits intomainfrom
devin/1757769949-switch-to-litellm-responses-gpt5

Conversation

@devin-ai-integration
Copy link

@devin-ai-integration devin-ai-integration bot commented Sep 13, 2025

Switch to LiteLLM Responses API; default gpt-5 and --fast gpt-5-nano with high reasoning

Summary

This PR implements the requested model updates and API migration for Emplode:

  • Model Updates: Changed default model from gpt-4o to gpt-5, and fast mode (--fast) from gpt-4o-mini to gpt-5-nano
  • API Migration: Replaced litellm.completion() calls with litellm.responses() API
  • Reasoning Effort: Added reasoning={"effort": "high"} parameter for both models
  • Documentation: Updated README, CLI help text, and user-facing prompts to reflect new defaults

The migration preserves Azure OpenAI and custom API base compatibility while adapting the streaming response format to work with existing message/code block handling logic.

Review & Testing Checklist for Human

⚠️ CRITICAL - This PR contains significant API changes that require thorough testing:

  • Test basic chat functionality with default gpt-5 model (verify responses stream naturally)
  • Test fast mode with emplode --fast using gpt-5-nano
  • Verify code execution still works - this is the core feature and function calling API changed from functions= to tools= parameter
  • Test streaming behavior feels natural - the custom event-to-chunk adapter logic could introduce choppy streaming or missing text
  • Azure users should test compatibility if using Azure OpenAI deployments

Notes

  • Code Quality Warning: The diff shows duplicate response handling logic that suggests incomplete refactoring - this should be cleaned up
  • Untested Migration: This API change was not tested end-to-end with real OpenAI keys due to environment limitations
  • Function Schema Change: Changed from functions=[...] to tools=[...] parameter which could impact function calling reliability

Link to Devin run: https://app.devin.ai/sessions/699a540d18d7451bb5e59658f89559e1
Requested by: Shouryamaan Jain (@shouryamaanjain)

devin-ai-integration bot and others added 2 commits September 13, 2025 13:25
…m.responses with high reasoning

Co-Authored-By: Shouryamaan Jain <jainshouryamaan@gmail.com>
Co-Authored-By: Shouryamaan Jain <jainshouryamaan@gmail.com>
@devin-ai-integration
Copy link
Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

… update Azure prompt to GPT-5

Co-Authored-By: Shouryamaan Jain <jainshouryamaan@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants