Any plans on integrating with litellm or making openai API compatible llm connections ?

[Greatz08]

Litellm is pretty great open source solution for connecting any project with 100+ LLM's easily without having to manually add support for different types of llms like openai,gemini,groq,grok etc etc. It can help in connecting with ollama open weights llms so it is win-win thing for both devs and users.

I believe users will like to try open weights llms because right now even 32B model is performing pretty great in thinking,solving or for agentic use cases so they would like to try qwq 32b latest model or gemma latest model which they are claiming can give performance on par with gemini 1.5.

If results will be bad then we can always switch to proprietary ones but again giving option to test is never a bad thing especially for open source projects :-))